Nov 28 18:30:31 user nova-compute[75203]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75203) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 18:30:31 user nova-compute[75203]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75203) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 18:30:31 user nova-compute[75203]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75203) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 28 18:30:31 user nova-compute[75203]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 28 18:30:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:30:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:30:31 user nova-compute[75203]: INFO nova.virt.driver [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 28 18:30:32 user nova-compute[75203]: INFO nova.compute.provider_config [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Acquiring lock "singleton_lock" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Acquired lock "singleton_lock" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Releasing lock "singleton_lock" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Full set of CONF: {{(pid=75203) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ******************************************************************************** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Configuration options gathered from: {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ================================================================================ {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] allow_resize_to_same_host      = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] arq_binding_timeout            = 300 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] backdoor_port                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] backdoor_socket                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] block_device_allocate_retries  = 300 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] block_device_allocate_retries_interval = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cert                           = self.pem {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute_monitors               = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] config_dir                     = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] config_drive_format            = iso9660 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] config_source                  = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] console_host                   = user {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] control_exchange               = nova {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cpu_allocation_ratio           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] daemon                         = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] debug                          = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] default_access_ip_network_name = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] default_availability_zone      = nova {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] default_ephemeral_format       = ext4 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] default_green_pool_size        = 1000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] default_schedule_zone          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] disk_allocation_ratio          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] enable_new_services            = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] enabled_ssl_apis               = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] flat_injected                  = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] force_config_drive             = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] force_raw_images               = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] graceful_shutdown_timeout      = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] heal_instance_info_cache_interval = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] host                           = user {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instance_build_timeout         = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instance_delete_interval       = 300 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instance_name_template         = instance-%08x {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instance_usage_audit           = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instance_usage_audit_period    = month {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] internal_service_availability_zone = internal {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] key                            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] live_migration_retry_count     = 30 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_config_append              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_dir                        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_file                       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_options                    = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_rotate_interval            = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_rotate_interval_type       = days {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] log_rotation_type              = none {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] long_rpc_timeout               = 1800 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] max_concurrent_builds          = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] max_concurrent_live_migrations = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] max_concurrent_snapshots       = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] max_local_block_devices        = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] max_logfile_count              = 30 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] max_logfile_size_mb            = 200 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] maximum_instance_delete_attempts = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] metadata_listen                = 0.0.0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] metadata_listen_port           = 8775 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] metadata_workers               = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] migrate_max_retries            = -1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] mkisofs_cmd                    = genisoimage {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] my_ip                          = 10.0.0.210 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] network_allocate_retries       = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] osapi_compute_listen_port      = 8774 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] osapi_compute_unique_server_name_scope =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] osapi_compute_workers          = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] password_length                = 12 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] periodic_enable                = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] periodic_fuzzy_delay           = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] pointer_model                  = ps2mouse {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] preallocate_images             = none {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] publish_errors                 = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] pybasedir                      = /opt/stack/nova {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ram_allocation_ratio           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rate_limit_burst               = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rate_limit_except_level        = CRITICAL {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rate_limit_interval            = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] reboot_timeout                 = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] reclaim_instance_interval      = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] record                         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] reimage_timeout_per_gb         = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] report_interval                = 120 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rescue_timeout                 = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] reserved_host_cpus             = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] reserved_host_disk_mb          = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] reserved_host_memory_mb        = 512 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] reserved_huge_pages            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] resize_confirm_window          = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] resize_fs_using_block_device   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] resume_guests_state_on_host_boot = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rpc_response_timeout           = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] run_external_periodic_tasks    = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] running_deleted_instance_action = reap {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] running_deleted_instance_timeout = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler_instance_sync_interval = 120 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_down_time              = 720 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] servicegroup_driver            = db {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] shelved_offload_time           = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] shelved_poll_interval          = 3600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] shutdown_timeout               = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] source_is_ipv6                 = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ssl_only                       = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] state_path                     = /opt/stack/data/nova {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] sync_power_state_interval      = 600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] sync_power_state_pool_size     = 1000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] syslog_log_facility            = LOG_USER {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] tempdir                        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] timeout_nbd                    = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] transport_url                  = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] update_resources_interval      = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] use_cow_images                 = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] use_eventlog                   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] use_journal                    = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] use_json                       = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] use_rootwrap_daemon            = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] use_stderr                     = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] use_syslog                     = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vcpu_pin_set                   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plugging_is_fatal          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plugging_timeout           = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] virt_mkfs                      = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] volume_usage_poll_interval     = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] watch_log_file                 = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] web                            = /usr/share/spice-html5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_concurrency.disable_process_locking = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.auth_strategy              = keystone {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.compute_link_prefix        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.dhcp_domain                = novalocal {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.enable_instance_password   = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.glance_link_prefix         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.instance_list_per_project_cells = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.list_records_by_skipping_down_cells = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.local_metadata_per_cell    = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.max_limit                  = 1000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.metadata_cache_expiration  = 15 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.neutron_default_tenant_id  = default {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.use_forwarded_for          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.use_neutron_default_nets   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.vendordata_dynamic_targets = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.vendordata_jsonfile_path   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.backend_argument         = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.config_prefix            = cache.oslo {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.dead_timeout             = 60.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.debug_cache_backend      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.enable_retry_client      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.enable_socket_keepalive  = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.enabled                  = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.expiration_time          = 600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.hashclient_retry_attempts = 2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_dead_retry      = 300 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_password        =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_sasl_enabled    = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.memcache_username        =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.proxies                  = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.retry_attempts           = 2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.retry_delay              = 0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.socket_keepalive_count   = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.socket_keepalive_idle    = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.socket_keepalive_interval = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.tls_allowed_ciphers      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.tls_cafile               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.tls_certfile             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.tls_enabled              = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cache.tls_keyfile              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.auth_section            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.auth_type               = password {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.cafile                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.certfile                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.collect_timing          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.cross_az_attach         = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.debug                   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.endpoint_template       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.http_retries            = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.insecure                = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.keyfile                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.os_region_name          = RegionOne {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.split_loggers           = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cinder.timeout                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.cpu_dedicated_set      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.cpu_shared_set         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.image_type_exclude_list = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.resource_provider_association_refresh = 300 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.shutdown_retry_interval = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] conductor.workers              = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] console.allowed_origins        = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] console.ssl_ciphers            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] console.ssl_minimum_version    = default {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] consoleauth.token_ttl          = 600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.cafile                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.certfile                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.collect_timing          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.connect_retries         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.connect_retry_delay     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.endpoint_override       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.insecure                = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.keyfile                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.max_version             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.min_version             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.region_name             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.service_name            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.service_type            = accelerator {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.split_loggers           = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.status_code_retries     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.status_code_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.timeout                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] cyborg.version                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.backend               = sqlalchemy {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.connection            = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.connection_debug      = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.connection_parameters =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.connection_recycle_time = 3600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.connection_trace      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.db_inc_retry_interval = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.db_max_retries        = 20 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.db_max_retry_interval = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.db_retry_interval     = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.max_overflow          = 50 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.max_pool_size         = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.max_retries           = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.mysql_wsrep_sync_wait = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.pool_timeout          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.retry_interval        = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.slave_connection      = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] database.sqlite_synchronous    = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.backend           = sqlalchemy {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.connection        = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.connection_debug  = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.connection_parameters =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.connection_recycle_time = 3600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.connection_trace  = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.db_inc_retry_interval = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.db_max_retries    = 20 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.db_max_retry_interval = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.db_retry_interval = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.max_overflow      = 50 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.max_pool_size     = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.max_retries       = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.pool_timeout      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.retry_interval    = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.slave_connection  = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] api_database.sqlite_synchronous = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] devices.enabled_mdev_types     = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ephemeral_storage_encryption.enabled = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.api_servers             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.cafile                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.certfile                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.collect_timing          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.connect_retries         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.connect_retry_delay     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.debug                   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.default_trusted_certificate_ids = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.enable_certificate_validation = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.enable_rbd_download     = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.endpoint_override       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.insecure                = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.keyfile                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.max_version             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.min_version             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.num_retries             = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.rbd_ceph_conf           =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.rbd_connect_timeout     = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.rbd_pool                =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.rbd_user                =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.region_name             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.service_name            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.service_type            = image {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.split_loggers           = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.status_code_retries     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.status_code_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.timeout                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.verify_glance_signatures = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] glance.version                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] guestfs.debug                  = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.config_drive_cdrom      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.config_drive_inject_password = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.enable_remotefx         = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.instances_path_share    =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.limit_cpu_features      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.use_multipath_io        = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.vswitch_name            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] mks.enabled                    = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] image_cache.manager_interval   = 2400 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] image_cache.precache_concurrency = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] image_cache.remove_unused_base_images = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] image_cache.subdirectory_name  = _base {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.api_max_retries         = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.api_retry_interval      = 2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.auth_section            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.auth_type               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.cafile                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.certfile                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.collect_timing          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.conductor_group         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.connect_retries         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.connect_retry_delay     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.endpoint_override       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.insecure                = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.keyfile                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.max_version             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.min_version             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.peer_list               = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.region_name             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.serial_console_state_timeout = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.service_name            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.service_type            = baremetal {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.split_loggers           = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.status_code_retries     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.status_code_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.timeout                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ironic.version                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] key_manager.fixed_key          = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.barbican_api_version  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.barbican_endpoint     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.barbican_endpoint_type = public {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.barbican_region_name  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.cafile                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.certfile              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.collect_timing        = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.insecure              = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.keyfile               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.number_of_retries     = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.retry_delay           = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.send_service_user_token = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.split_loggers         = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.timeout               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.verify_ssl            = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican.verify_ssl_path       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.auth_section = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.auth_type = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.cafile   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.certfile = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.collect_timing = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.insecure = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.keyfile  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.split_loggers = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] barbican_service_user.timeout  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.approle_role_id          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.approle_secret_id        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.cafile                   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.certfile                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.collect_timing           = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.insecure                 = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.keyfile                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.kv_mountpoint            = secret {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.kv_path                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.kv_version               = 2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.namespace                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.root_token_id            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.split_loggers            = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.ssl_ca_crt_file          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.timeout                  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.use_ssl                  = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.auth_section          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.auth_type             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.cafile                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.certfile              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.collect_timing        = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.connect_retries       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.connect_retry_delay   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.endpoint_override     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.insecure              = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.keyfile               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.max_version           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.min_version           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.region_name           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.service_name          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.service_type          = identity {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.split_loggers         = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.status_code_retries   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.status_code_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.timeout               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] keystone.version               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.connection_uri         =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.cpu_mode               = custom {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: WARNING oslo_config.cfg [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.cpu_power_governor_high = performance {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.cpu_power_management   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.device_detach_attempts = 8 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.device_detach_timeout  = 20 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.disk_cachemodes        = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.disk_prefix            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.enabled_perf_events    = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.file_backed_memory     = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.gid_maps               = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.hw_disk_discard        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.hw_machine_type        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.images_rbd_pool        = rbd {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.images_type            = default {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.images_volume_group    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.inject_key             = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.inject_partition       = -2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.inject_password        = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.iscsi_iface            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.iser_use_multipath     = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_downtime = 500 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_inbound_addr = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_scheme  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_timeout_action = abort {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_tunnelled = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: WARNING oslo_config.cfg [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 28 18:30:32 user nova-compute[75203]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 28 18:30:32 user nova-compute[75203]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 28 18:30:32 user nova-compute[75203]: and ``live_migration_inbound_addr`` respectively.
Nov 28 18:30:32 user nova-compute[75203]: ).  Its value may be silently ignored in the future.
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.live_migration_with_native_tls = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.max_queues             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.nfs_mount_options      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.num_pcie_ports         = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.pmem_namespaces        = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.quobyte_client_cfg     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rbd_secret_uuid        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rbd_user               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rescue_image_id        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rescue_kernel_id       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.rx_queue_size          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.smbfs_mount_options    =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.snapshot_compression   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.snapshot_image_format  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.sparse_logical_volumes = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.swtpm_enabled          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.swtpm_group            = tss {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.swtpm_user             = tss {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.sysinfo_serial         = unique {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.tb_cache_size          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.tx_queue_size          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.uid_maps               = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.use_virtio_for_bridges = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.virt_type              = kvm {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.volume_clear           = zero {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.volume_clear_size      = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.volume_use_multipath   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.vzstorage_cache_path   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.auth_section           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.auth_type              = password {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.cafile                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.certfile               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.collect_timing         = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.connect_retries        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.connect_retry_delay    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.default_floating_pool  = public {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.endpoint_override      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.extension_sync_interval = 600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.http_retries           = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.insecure               = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.keyfile                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.max_version            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.min_version            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.ovs_bridge             = br-int {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.physnets               = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.region_name            = RegionOne {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.service_metadata_proxy = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.service_name           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.service_type           = network {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.split_loggers          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.status_code_retries    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.status_code_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.timeout                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] neutron.version                = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] notifications.bdms_in_notifications = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] notifications.default_level    = INFO {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] notifications.notification_format = unversioned {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] notifications.notify_on_state_change = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] pci.alias                      = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] pci.device_spec                = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] pci.report_in_placement        = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.auth_section         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.auth_type            = password {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.cafile               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.certfile             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.collect_timing       = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.connect_retries      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.connect_retry_delay  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.default_domain_id    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.default_domain_name  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.domain_id            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.domain_name          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.endpoint_override    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.insecure             = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.keyfile              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.max_version          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.min_version          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.password             = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.project_domain_id    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.project_domain_name  = Default {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.project_id           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.project_name         = service {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.region_name          = RegionOne {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.service_name         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.service_type         = placement {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.split_loggers        = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.status_code_retries  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.status_code_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.system_scope         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.timeout              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.trust_id             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.user_domain_id       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.user_domain_name     = Default {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.user_id              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.username             = placement {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] placement.version              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.cores                    = 20 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.count_usage_from_placement = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.injected_file_content_bytes = 10240 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.injected_file_path_length = 255 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.injected_files           = 5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.instances                = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.key_pairs                = 100 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.metadata_items           = 128 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.ram                      = 51200 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.recheck_quota            = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.server_group_members     = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] quota.server_groups            = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rdp.enabled                    = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.image_metadata_prefilter = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.max_attempts         = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.max_placement_results = 1000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] scheduler.workers              = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.host_subset_size = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.isolated_hosts = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.isolated_images = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.pci_in_placement = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.track_instance_changes = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] metrics.required               = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] metrics.weight_multiplier      = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] metrics.weight_setting         = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] serial_console.enabled         = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] serial_console.port_range      = 10000:20000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] serial_console.serialproxy_port = 6083 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.auth_section      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.auth_type         = password {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.cafile            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.certfile          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.collect_timing    = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.insecure          = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.keyfile           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.send_service_user_token = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.split_loggers     = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] service_user.timeout           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.agent_enabled            = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.enabled                  = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.html5proxy_port          = 6082 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.image_compression        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.jpeg_compression         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.playback_compression     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.server_listen            = 127.0.0.1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.streaming_mode           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] spice.zlib_compression         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] upgrade_levels.baseapi         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] upgrade_levels.compute         = auto {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] upgrade_levels.conductor       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] upgrade_levels.scheduler       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.cafile = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.certfile = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.insecure = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vendordata_dynamic_auth.timeout = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.api_retry_count         = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.ca_file                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.cache_prefix            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.cluster_name            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.connection_pool_size    = 10 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.console_delay_seconds   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.datastore_regex         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.host_ip                 = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.host_password           = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.host_port               = 443 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.host_username           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.insecure                = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.integration_bridge      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.maximum_objects         = 100 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.pbm_default_policy      = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.pbm_enabled             = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.pbm_wsdl_location       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.serial_port_proxy_uri   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.serial_port_service_uri = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.task_poll_interval      = 0.5 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.use_linked_clone        = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.vnc_keymap              = en-us {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.vnc_port                = 5900 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vmware.vnc_port_total          = 10000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.auth_schemes               = ['none'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.enabled                    = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.novncproxy_port            = 6080 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.vencrypt_ca_certs          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.vencrypt_client_cert       = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vnc.vencrypt_client_key        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.disable_rootwrap   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.enable_numa_live_migration = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.libvirt_disable_apic = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.client_socket_timeout     = 900 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.default_pool_size         = 1000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.keep_alive                = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.max_header_line           = 16384 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.ssl_ca_file               = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.ssl_cert_file             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.ssl_key_file              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.tcp_keepidle              = 600 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] zvm.ca_file                    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] zvm.cloud_connector_url        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] zvm.reachable_timeout          = 300 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.enforce_new_defaults = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.enforce_scope      = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.policy_default_rule = default {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.connection_string     = messaging:// {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.enabled               = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.es_doc_type           = notification {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.es_scroll_size        = 10000 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.es_scroll_time        = 2m {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.filter_error_trace    = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.hmac_keys             = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.sentinel_service_name = mymaster {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.socket_timeout        = 0.1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.trace_requests        = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler.trace_sqlalchemy      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler_jaeger.process_tags   = {} {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler_jaeger.service_name_prefix = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] profiler_otlp.service_name_prefix = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] remote_debug.host              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] remote_debug.port              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_notifications.retry = -1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.auth_section        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.auth_type           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.cafile              = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.certfile            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.collect_timing      = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.connect_retries     = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.connect_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.endpoint_id         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.endpoint_override   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.insecure            = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.keyfile             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.max_version         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.min_version         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.region_name         = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.service_name        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.service_type        = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.split_loggers       = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.status_code_retries = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.status_code_retry_delay = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.timeout             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.valid_interfaces    = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_limit.version             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_reports.file_event_handler = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] oslo_reports.log_dir           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_ovs_privileged.group  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] vif_plug_ovs_privileged.user   = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_ovs.isolate_vif         = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] os_brick.lock_path             = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] privsep_osbrick.capabilities   = [21] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] privsep_osbrick.group          = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] privsep_osbrick.helper_command = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] privsep_osbrick.user           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] nova_sys_admin.group           = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] nova_sys_admin.helper_command  = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] nova_sys_admin.user            = None {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG oslo_service.service [None req-5754b7d0-415d-49b6-b19a-c40d26bcdb33 None None] ******************************************************************************** {{(pid=75203) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 28 18:30:32 user nova-compute[75203]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 28 18:30:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Connecting to libvirt: qemu:///system {{(pid=75203) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f07a849e260> {{(pid=75203) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 28 18:30:32 user nova-compute[75203]: libvirt:  error : internal error: could not initialize domain event timer
Nov 28 18:30:32 user nova-compute[75203]: WARNING nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 28 18:30:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f07a849e260> {{(pid=75203) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Starting native event thread {{(pid=75203) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Starting green dispatch thread {{(pid=75203) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 28 18:30:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Starting connection event dispatch thread {{(pid=75203) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 28 18:30:32 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Connection event '1' reason 'None'
Nov 28 18:30:32 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 18:30:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.mount [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Initialising _HostMountState generation 0 {{(pid=75203) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 28 18:30:39 user nova-compute[75203]: INFO nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host capabilities <capabilities>
Nov 28 18:30:39 user nova-compute[75203]:   <host>
Nov 28 18:30:39 user nova-compute[75203]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 28 18:30:39 user nova-compute[75203]:     <cpu>
Nov 28 18:30:39 user nova-compute[75203]:       <arch>x86_64</arch>
Nov 28 18:30:39 user nova-compute[75203]:       <model>IvyBridge-IBRS</model>
Nov 28 18:30:39 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:39 user nova-compute[75203]:       <microcode version='1070'/>
Nov 28 18:30:39 user nova-compute[75203]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 28 18:30:39 user nova-compute[75203]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='ss'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='vmx'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='pcid'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='osxsave'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='hypervisor'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='arat'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='tsc_adjust'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='md-clear'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='stibp'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='arch-capabilities'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='ssbd'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='invtsc'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='rsba'/>
Nov 28 18:30:39 user nova-compute[75203]:       <feature name='skip-l1dfl-vmentry'/>
Nov 28 18:30:39 user nova-compute[75203]:       <pages unit='KiB' size='4'/>
Nov 28 18:30:39 user nova-compute[75203]:       <pages unit='KiB' size='2048'/>
Nov 28 18:30:39 user nova-compute[75203]:     </cpu>
Nov 28 18:30:39 user nova-compute[75203]:     <power_management>
Nov 28 18:30:39 user nova-compute[75203]:       <suspend_mem/>
Nov 28 18:30:39 user nova-compute[75203]:       <suspend_disk/>
Nov 28 18:30:39 user nova-compute[75203]:       <suspend_hybrid/>
Nov 28 18:30:39 user nova-compute[75203]:     </power_management>
Nov 28 18:30:39 user nova-compute[75203]:     <iommu support='no'/>
Nov 28 18:30:39 user nova-compute[75203]:     <migration_features>
Nov 28 18:30:39 user nova-compute[75203]:       <live/>
Nov 28 18:30:39 user nova-compute[75203]:       <uri_transports>
Nov 28 18:30:39 user nova-compute[75203]:         <uri_transport>tcp</uri_transport>
Nov 28 18:30:39 user nova-compute[75203]:         <uri_transport>rdma</uri_transport>
Nov 28 18:30:39 user nova-compute[75203]:       </uri_transports>
Nov 28 18:30:39 user nova-compute[75203]:     </migration_features>
Nov 28 18:30:39 user nova-compute[75203]:     <topology>
Nov 28 18:30:39 user nova-compute[75203]:       <cells num='2'>
Nov 28 18:30:39 user nova-compute[75203]:         <cell id='0'>
Nov 28 18:30:39 user nova-compute[75203]:           <memory unit='KiB'>8140616</memory>
Nov 28 18:30:39 user nova-compute[75203]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 28 18:30:39 user nova-compute[75203]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 18:30:39 user nova-compute[75203]:           <distances>
Nov 28 18:30:39 user nova-compute[75203]:             <sibling id='0' value='10'/>
Nov 28 18:30:39 user nova-compute[75203]:             <sibling id='1' value='20'/>
Nov 28 18:30:39 user nova-compute[75203]:           </distances>
Nov 28 18:30:39 user nova-compute[75203]:           <cpus num='6'>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 28 18:30:39 user nova-compute[75203]:           </cpus>
Nov 28 18:30:39 user nova-compute[75203]:         </cell>
Nov 28 18:30:39 user nova-compute[75203]:         <cell id='1'>
Nov 28 18:30:39 user nova-compute[75203]:           <memory unit='KiB'>8255100</memory>
Nov 28 18:30:39 user nova-compute[75203]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 28 18:30:39 user nova-compute[75203]:           <pages unit='KiB' size='2048'>0</pages>
Nov 28 18:30:39 user nova-compute[75203]:           <distances>
Nov 28 18:30:39 user nova-compute[75203]:             <sibling id='0' value='20'/>
Nov 28 18:30:39 user nova-compute[75203]:             <sibling id='1' value='10'/>
Nov 28 18:30:39 user nova-compute[75203]:           </distances>
Nov 28 18:30:39 user nova-compute[75203]:           <cpus num='6'>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 28 18:30:39 user nova-compute[75203]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 28 18:30:39 user nova-compute[75203]:           </cpus>
Nov 28 18:30:39 user nova-compute[75203]:         </cell>
Nov 28 18:30:39 user nova-compute[75203]:       </cells>
Nov 28 18:30:39 user nova-compute[75203]:     </topology>
Nov 28 18:30:39 user nova-compute[75203]:     <cache>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 28 18:30:39 user nova-compute[75203]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 28 18:30:39 user nova-compute[75203]:     </cache>
Nov 28 18:30:39 user nova-compute[75203]:     <secmodel>
Nov 28 18:30:39 user nova-compute[75203]:       <model>apparmor</model>
Nov 28 18:30:39 user nova-compute[75203]:       <doi>0</doi>
Nov 28 18:30:39 user nova-compute[75203]:     </secmodel>
Nov 28 18:30:39 user nova-compute[75203]:     <secmodel>
Nov 28 18:30:39 user nova-compute[75203]:       <model>dac</model>
Nov 28 18:30:39 user nova-compute[75203]:       <doi>0</doi>
Nov 28 18:30:39 user nova-compute[75203]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 28 18:30:39 user nova-compute[75203]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 28 18:30:39 user nova-compute[75203]:     </secmodel>
Nov 28 18:30:39 user nova-compute[75203]:   </host>
Nov 28 18:30:39 user nova-compute[75203]:   <guest>
Nov 28 18:30:39 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:39 user nova-compute[75203]:     <arch name='alpha'>
Nov 28 18:30:39 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:39 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>clipper</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:39 user nova-compute[75203]:     </arch>
Nov 28 18:30:39 user nova-compute[75203]:     <features>
Nov 28 18:30:39 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:39 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:39 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:39 user nova-compute[75203]:     </features>
Nov 28 18:30:39 user nova-compute[75203]:   </guest>
Nov 28 18:30:39 user nova-compute[75203]:   <guest>
Nov 28 18:30:39 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:39 user nova-compute[75203]:     <arch name='armv6l'>
Nov 28 18:30:39 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:39 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>spitz</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>nuri</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>kzm</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>sx1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>z2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>tosa</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>n810</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>n800</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>terrier</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>midway</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>microbit</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>verdex</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>highbank</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>akita</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>connex</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>collie</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:39 user nova-compute[75203]:     </arch>
Nov 28 18:30:39 user nova-compute[75203]:     <features>
Nov 28 18:30:39 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:39 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:39 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:39 user nova-compute[75203]:     </features>
Nov 28 18:30:39 user nova-compute[75203]:   </guest>
Nov 28 18:30:39 user nova-compute[75203]:   <guest>
Nov 28 18:30:39 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:39 user nova-compute[75203]:     <arch name='armv7l'>
Nov 28 18:30:39 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:39 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>spitz</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>nuri</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>kzm</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>sx1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>z2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>tosa</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>n810</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>n800</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>terrier</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>midway</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>microbit</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>verdex</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='4'>highbank</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>akita</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>connex</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>collie</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 18:30:39 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:39 user nova-compute[75203]:     </arch>
Nov 28 18:30:39 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='aarch64'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>integratorcp</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>borzoi</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>spitz</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>nuri</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>musca-b1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>versatileab</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>kzm</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>musca-a</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>smdkc210</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sx1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>z2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>tosa</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>sabrelite</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>realview-eb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>n810</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>n800</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>versatilepb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>terrier</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mainstone</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>midway</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>musicpal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>microbit</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>cubieboard</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>verdex</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>netduino2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>raspi3b</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>raspi2b</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>cheetah</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>highbank</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>akita</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>connex</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>collie</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>raspi0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <acpi default='on' toggle='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='cris'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='i686'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>isapc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>microvm</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='kvm'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <pae/>
Nov 28 18:30:40 user nova-compute[75203]:       <nonpae/>
Nov 28 18:30:40 user nova-compute[75203]:       <acpi default='on' toggle='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:       <apic default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='m68k'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>an5206</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>q800</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>next-cube</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='microblaze'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='microblazeel'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='mips'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='16'>malta</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='mipsel'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='16'>malta</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='mips64'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='16'>malta</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>pica61</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>magnum</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='mips64el'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='16'>malta</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mipssim</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>pica61</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>magnum</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='16'>boston</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='ppc'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mac99</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>40p</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>taihu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='ppc64'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>taihu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>40p</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mac99</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='ppc64le'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2048'>powernv9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>taihu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2048'>powernv10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>ppce500</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>40p</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>pegasos2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>bamboo</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>g3beige</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>mac99</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sam460ex</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>ref405ep</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2048'>powernv8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='riscv32'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='8'>spike</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>opentitan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='8'>virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='riscv64'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='8'>spike</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='5'>sifive_u</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>shakti_c</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sifive_e</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='8'>virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='s390x'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='sh4'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>shix</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>r2d</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='sh4eb'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>shix</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>r2d</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='sparc'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>SS-5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>SS-20</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>LX</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>SS-4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>SS-10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>Voyager</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='sparc64'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sun4u</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>niagara</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>sun4v</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='x86_64'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>64</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>x-remote</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='1'>isapc</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>microvm</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='kvm'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <acpi default='on' toggle='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:       <apic default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='xtensa'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>sim</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>kc705</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>ml605</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx200</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx60</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]:   <guest>
Nov 28 18:30:40 user nova-compute[75203]:     <os_type>hvm</os_type>
Nov 28 18:30:40 user nova-compute[75203]:     <arch name='xtensaeb'>
Nov 28 18:30:40 user nova-compute[75203]:       <wordsize>32</wordsize>
Nov 28 18:30:40 user nova-compute[75203]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='4'>sim</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>kc705</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>ml605</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>virt</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx200</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>lx60</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 28 18:30:40 user nova-compute[75203]:       <domain type='qemu'/>
Nov 28 18:30:40 user nova-compute[75203]:     </arch>
Nov 28 18:30:40 user nova-compute[75203]:     <features>
Nov 28 18:30:40 user nova-compute[75203]:       <cpuselection/>
Nov 28 18:30:40 user nova-compute[75203]:       <deviceboot/>
Nov 28 18:30:40 user nova-compute[75203]:       <disksnapshot default='on' toggle='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     </features>
Nov 28 18:30:40 user nova-compute[75203]:   </guest>
Nov 28 18:30:40 user nova-compute[75203]: </capabilities>
Nov 28 18:30:40 user nova-compute[75203]: 
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-q35-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>i686</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='288'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'/>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='lm'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-i440fx-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>i686</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='255'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'/>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='lm'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ide</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-i440fx-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>i686</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='255'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'/>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='lm'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ide</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-i386</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-q35-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>i686</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='288'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'/>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='lm'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-q35-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>x86_64</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='288'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>efi</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='invtsc'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='rsba'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-i440fx-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>x86_64</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='255'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>efi</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='invtsc'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='rsba'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ide</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-i440fx-jammy</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>x86_64</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='255'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>efi</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='invtsc'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='rsba'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ide</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 28 18:30:40 user nova-compute[75203]: <domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 28 18:30:40 user nova-compute[75203]:   <domain>kvm</domain>
Nov 28 18:30:40 user nova-compute[75203]:   <machine>pc-q35-6.2</machine>
Nov 28 18:30:40 user nova-compute[75203]:   <arch>x86_64</arch>
Nov 28 18:30:40 user nova-compute[75203]:   <vcpu max='288'/>
Nov 28 18:30:40 user nova-compute[75203]:   <iothreads supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:   <os supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='firmware'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>efi</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:     <loader supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>rom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pflash</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='readonly'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='secure'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>yes</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>no</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </loader>
Nov 28 18:30:40 user nova-compute[75203]:   </os>
Nov 28 18:30:40 user nova-compute[75203]:   <cpu>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-passthrough' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='hostPassthroughMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='maximum' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='maximumMigratable'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>on</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>off</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='host-model' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <vendor>Intel</vendor>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ss'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='vmx'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pcid'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='hypervisor'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arat'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='tsc_adjust'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='umip'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='md-clear'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='arch-capabilities'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='invtsc'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibpb'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='ibrs'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-stibp'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='amd-ssbd'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='rsba'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='require' name='pschange-mc-no'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='erms'/>
Nov 28 18:30:40 user nova-compute[75203]:       <feature policy='disable' name='xsaveopt'/>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:     <mode name='custom' supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>qemu64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>qemu32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>phenom</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>pentium</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>n270</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm64</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>kvm32</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>coreduo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>core2duo</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>athlon</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Westmere</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Snowridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Skylake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>SandyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Penryn</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G5</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G4</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G3</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Opteron_G2</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Opteron_G1</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>IvyBridge</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Icelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Haswell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Rome</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-Milan</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC-IBPB</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>EPYC</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Dhyana</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cooperlake</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>Conroe</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Cascadelake-Server</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-noTSX</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell-IBRS</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='no'>Broadwell</model>
Nov 28 18:30:40 user nova-compute[75203]:       <model usable='yes'>486</model>
Nov 28 18:30:40 user nova-compute[75203]:     </mode>
Nov 28 18:30:40 user nova-compute[75203]:   </cpu>
Nov 28 18:30:40 user nova-compute[75203]:   <memoryBacking supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:     <enum name='sourceType'>
Nov 28 18:30:40 user nova-compute[75203]:       <value>file</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>anonymous</value>
Nov 28 18:30:40 user nova-compute[75203]:       <value>memfd</value>
Nov 28 18:30:40 user nova-compute[75203]:     </enum>
Nov 28 18:30:40 user nova-compute[75203]:   </memoryBacking>
Nov 28 18:30:40 user nova-compute[75203]:   <devices>
Nov 28 18:30:40 user nova-compute[75203]:     <disk supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='diskDevice'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>disk</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cdrom</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>floppy</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>lun</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='bus'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>fdc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sata</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </disk>
Nov 28 18:30:40 user nova-compute[75203]:     <graphics supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='type'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>sdl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vnc</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>spice</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egl-headless</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </graphics>
Nov 28 18:30:40 user nova-compute[75203]:     <video supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='modelType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>cirrus</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>vmvga</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>qxl</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>none</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>bochs</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>ramfb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </video>
Nov 28 18:30:40 user nova-compute[75203]:     <hostdev supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='mode'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>subsystem</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='startupPolicy'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>default</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>mandatory</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>requisite</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>optional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='subsysType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>usb</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>pci</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>scsi</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='capsType'/>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='pciBackend'/>
Nov 28 18:30:40 user nova-compute[75203]:     </hostdev>
Nov 28 18:30:40 user nova-compute[75203]:     <rng supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtio-non-transitional</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>random</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>egd</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>builtin</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </rng>
Nov 28 18:30:40 user nova-compute[75203]:     <filesystem supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='driverType'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>path</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>handle</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>virtiofs</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </filesystem>
Nov 28 18:30:40 user nova-compute[75203]:     <tpm supported='yes'>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='model'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-tis</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>tpm-crb</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:       <enum name='backendModel'>
Nov 28 18:30:40 user nova-compute[75203]:         <value>passthrough</value>
Nov 28 18:30:40 user nova-compute[75203]:         <value>emulator</value>
Nov 28 18:30:40 user nova-compute[75203]:       </enum>
Nov 28 18:30:40 user nova-compute[75203]:     </tpm>
Nov 28 18:30:40 user nova-compute[75203]:   </devices>
Nov 28 18:30:40 user nova-compute[75203]:   <features>
Nov 28 18:30:40 user nova-compute[75203]:     <gic supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:     <vmcoreinfo supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <genid supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backingStoreInput supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <backup supported='yes'/>
Nov 28 18:30:40 user nova-compute[75203]:     <sev supported='no'/>
Nov 28 18:30:40 user nova-compute[75203]:   </features>
Nov 28 18:30:40 user nova-compute[75203]: </domainCapabilities>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75203) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75203) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Checking secure boot support for host arch (x86_64) {{(pid=75203) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 28 18:30:40 user nova-compute[75203]: INFO nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Secure Boot support detected
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] cpu compare xml: <cpu match="exact">
Nov 28 18:30:40 user nova-compute[75203]:   <model>Nehalem</model>
Nov 28 18:30:40 user nova-compute[75203]: </cpu>
Nov 28 18:30:40 user nova-compute[75203]:  {{(pid=75203) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 28 18:30:40 user nova-compute[75203]: INFO nova.virt.node [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Generated node identity 124a0dbb-54e7-4217-a850-c2ea3ab9818b
Nov 28 18:30:40 user nova-compute[75203]: INFO nova.virt.node [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Wrote node identity 124a0dbb-54e7-4217-a850-c2ea3ab9818b to /opt/stack/data/nova/compute_id
Nov 28 18:30:40 user nova-compute[75203]: WARNING nova.compute.manager [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Compute nodes ['124a0dbb-54e7-4217-a850-c2ea3ab9818b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 28 18:30:40 user nova-compute[75203]: INFO nova.compute.manager [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 28 18:30:40 user nova-compute[75203]: WARNING nova.compute.manager [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 28 18:30:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:30:40 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:30:40 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Hypervisor/Node resource view: name=user free_ram=10977MB free_disk=26.00719451904297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:30:40 user nova-compute[75203]: WARNING nova.compute.resource_tracker [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] No compute node record for user:124a0dbb-54e7-4217-a850-c2ea3ab9818b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 124a0dbb-54e7-4217-a850-c2ea3ab9818b could not be found.
Nov 28 18:30:40 user nova-compute[75203]: INFO nova.compute.resource_tracker [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Compute node record created for user:user with uuid: 124a0dbb-54e7-4217-a850-c2ea3ab9818b
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:30:40 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] [req-8a644a38-0412-48f0-81d0-252a11357a8c] Created resource provider record via placement API for resource provider with UUID 124a0dbb-54e7-4217-a850-c2ea3ab9818b and name user.
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75203) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 28 18:30:40 user nova-compute[75203]: INFO nova.virt.libvirt.host [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] kernel doesn't support AMD SEV
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 18:30:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Libvirt baseline CPU <cpu>
Nov 28 18:30:41 user nova-compute[75203]:   <arch>x86_64</arch>
Nov 28 18:30:41 user nova-compute[75203]:   <model>Nehalem</model>
Nov 28 18:30:41 user nova-compute[75203]:   <vendor>Intel</vendor>
Nov 28 18:30:41 user nova-compute[75203]:   <topology sockets="6" cores="1" threads="1"/>
Nov 28 18:30:41 user nova-compute[75203]: </cpu>
Nov 28 18:30:41 user nova-compute[75203]:  {{(pid=75203) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Updated inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Updating resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b generation from 0 to 1 during operation: update_inventory {{(pid=75203) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Updating resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b generation from 1 to 2 during operation: update_traits {{(pid=75203) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.service [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Creating RPC server for service compute {{(pid=75203) start /opt/stack/nova/nova/service.py:182}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.service [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] Join ServiceGroup membership for this service compute {{(pid=75203) start /opt/stack/nova/nova/service.py:199}}
Nov 28 18:30:41 user nova-compute[75203]: DEBUG nova.servicegroup.drivers.db [None req-159dc4da-a5ad-45e3-9f4e-6cb0f50a388f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75203) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 28 18:30:48 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_power_states {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:30:48 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:31:31 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:31:32 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:31:32 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:31:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=10405MB free_disk=25.910900115966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:31:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:32:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:32:33 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:32:33 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:32:33 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=10346MB free_disk=25.97522735595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:32:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:32:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:32:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:32:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:32:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 18:32:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:33:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:33:33 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:33:34 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:33:34 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:33:34 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=10384MB free_disk=25.727615356445312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:33:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:33:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:33:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:33:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:33:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 18:33:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:34:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:35 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:34:36 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:36 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:36 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9632MB free_disk=25.747821807861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:34:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:34:42 user nova-compute[75203]: INFO nova.compute.claims [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Claim successful on node user
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:34:42 user nova-compute[75203]: INFO nova.compute.claims [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Claim successful on node user
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:34:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:34:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Creating image(s)
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "/opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "/opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "/opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:34:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:34:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.policy [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f96761cb11ad45b0bbc9a0435d3c0324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d19b759f9948c9be9be5097069099b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.policy [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c13aa85b0714209b9d5a36b1356b596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c3564b61b84ad18e5a52b5a83db952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.virt.images [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] 6c841bc3-8129-43e8-9397-445eaf245bad was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.part /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:34:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Creating image(s)
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.part /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.converted" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:43 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:34:43 user nova-compute[75203]: INFO nova.compute.claims [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Claim successful on node user
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.200s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:44 user nova-compute[75203]: INFO oslo.privsep.daemon [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0ye0vii3/privsep.sock']
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.278s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:44 user sudo[84504]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0ye0vii3/privsep.sock
Nov 28 18:34:44 user sudo[84504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.128s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:34:44 user nova-compute[75203]: INFO nova.compute.claims [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Claim successful on node user
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:34:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:34:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Creating image(s)
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.policy [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f96761cb11ad45b0bbc9a0435d3c0324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d19b759f9948c9be9be5097069099b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:34:44 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:34:45 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:34:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:34:45 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Creating image(s)
Nov 28 18:34:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG nova.policy [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1a7cdac05464b9ca3ef185aafe6ea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4d281e6da4779a68b17ecd896e6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:34:45 user sudo[84504]: pam_unix(sudo:session): session closed for user root
Nov 28 18:34:45 user nova-compute[75203]: INFO oslo.privsep.daemon [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Spawned new privsep daemon via rootwrap
Nov 28 18:34:45 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 18:34:45 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 18:34:45 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 28 18:34:45 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84511
Nov 28 18:34:45 user nova-compute[75203]: WARNING oslo_privsep.priv_context [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] privsep daemon already running
Nov 28 18:34:45 user nova-compute[75203]: WARNING oslo_privsep.priv_context [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] privsep daemon already running
Nov 28 18:34:45 user nova-compute[75203]: WARNING oslo_privsep.priv_context [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] privsep daemon already running
Nov 28 18:34:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Successfully created port: 26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.232s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.243s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk 1073741824" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.332s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Successfully created port: 376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.236s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk 1073741824" returned: 0 in 0.061s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.602s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Cannot resize image /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Ensure instance console log exists: /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.201s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.200s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk 1073741824" returned: 0 in 0.059s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.833s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.009s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Cannot resize image /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Ensure instance console log exists: /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.163s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Successfully created port: e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk 1073741824" returned: 0 in 0.143s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Cannot resize image /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Ensure instance console log exists: /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:34:47 user nova-compute[75203]: INFO nova.compute.claims [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Claim successful on node user
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Cannot resize image /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Ensure instance console log exists: /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:34:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:34:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:34:48 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Creating image(s)
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "/opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "/opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "/opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Successfully created port: e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.policy [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b7ea4623ff14b2ea244c31ac84dd600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '974923cb2e06473bbd8e4122888494df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk 1073741824" returned: 0 in 0.044s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Cannot resize image /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Ensure instance console log exists: /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Successfully updated port: 376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquired lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Successfully updated port: 26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received event network-changed-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Refreshing instance network info cache due to event network-changed-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] Acquiring lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-changed-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Refreshing instance network info cache due to event network-changed-26a39e18-8e9a-4f09-93f5-bc59364ca68e. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] Acquiring lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Successfully updated port: e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updating instance_info_cache with network_info: [{"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Releasing lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Instance network_info: |[{"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] Acquired lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.neutron [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Refreshing network info cache for port 376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Start _get_guest_xml network_info=[{"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:34:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1537440989',display_name='tempest-DeleteServersTestJSON-server-1537440989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1537440989',id=1,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98c3564b61b84ad18e5a52b5a83db952',ramdisk_id='',reservation_id='r-r0o4bs6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1581373654',owner_user_name='tempest-DeleteServersTestJSON-1581373654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:43Z,user_data=None,user_id='0c13aa85b0714209b9d5a36b1356b596',uuid=b48f122d-af9c-400c-8a7a-0c1303cc0cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Converting VIF {"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:ba,bridge_name='br-int',has_traffic_filtering=True,id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1,network=Network(80b9ac5a-b87d-45fa-b187-1c2edb345f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376d8ef0-5e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.objects.instance [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lazy-loading 'pci_devices' on Instance uuid b48f122d-af9c-400c-8a7a-0c1303cc0cb8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:34:50 user nova-compute[75203]:   <uuid>b48f122d-af9c-400c-8a7a-0c1303cc0cb8</uuid>
Nov 28 18:34:50 user nova-compute[75203]:   <name>instance-00000001</name>
Nov 28 18:34:50 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:34:50 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:34:50 user nova-compute[75203]:   <metadata>
Nov 28 18:34:50 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:34:50 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:34:50 user nova-compute[75203]:       <nova:name>tempest-DeleteServersTestJSON-server-1537440989</nova:name>
Nov 28 18:34:50 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:34:50</nova:creationTime>
Nov 28 18:34:50 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:34:50 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:34:50 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:34:50 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:34:50 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:34:50 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:34:50 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:34:50 user nova-compute[75203]:       <nova:owner>
Nov 28 18:34:50 user nova-compute[75203]:         <nova:user uuid="0c13aa85b0714209b9d5a36b1356b596">tempest-DeleteServersTestJSON-1581373654-project-member</nova:user>
Nov 28 18:34:50 user nova-compute[75203]:         <nova:project uuid="98c3564b61b84ad18e5a52b5a83db952">tempest-DeleteServersTestJSON-1581373654</nova:project>
Nov 28 18:34:50 user nova-compute[75203]:       </nova:owner>
Nov 28 18:34:50 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:34:50 user nova-compute[75203]:       <nova:ports>
Nov 28 18:34:50 user nova-compute[75203]:         <nova:port uuid="376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1">
Nov 28 18:34:50 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:34:50 user nova-compute[75203]:         </nova:port>
Nov 28 18:34:50 user nova-compute[75203]:       </nova:ports>
Nov 28 18:34:50 user nova-compute[75203]:     </nova:instance>
Nov 28 18:34:50 user nova-compute[75203]:   </metadata>
Nov 28 18:34:50 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:34:50 user nova-compute[75203]:     <system>
Nov 28 18:34:50 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:34:50 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:34:50 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:34:50 user nova-compute[75203]:       <entry name="serial">b48f122d-af9c-400c-8a7a-0c1303cc0cb8</entry>
Nov 28 18:34:50 user nova-compute[75203]:       <entry name="uuid">b48f122d-af9c-400c-8a7a-0c1303cc0cb8</entry>
Nov 28 18:34:50 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:34:50 user nova-compute[75203]:     </system>
Nov 28 18:34:50 user nova-compute[75203]:   </sysinfo>
Nov 28 18:34:50 user nova-compute[75203]:   <os>
Nov 28 18:34:50 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:34:50 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:34:50 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:34:50 user nova-compute[75203]:   </os>
Nov 28 18:34:50 user nova-compute[75203]:   <features>
Nov 28 18:34:50 user nova-compute[75203]:     <acpi/>
Nov 28 18:34:50 user nova-compute[75203]:     <apic/>
Nov 28 18:34:50 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:34:50 user nova-compute[75203]:   </features>
Nov 28 18:34:50 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:34:50 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:34:50 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:34:50 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:34:50 user nova-compute[75203]:   </clock>
Nov 28 18:34:50 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:34:50 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:34:50 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:34:50 user nova-compute[75203]:   </cpu>
Nov 28 18:34:50 user nova-compute[75203]:   <devices>
Nov 28 18:34:50 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:34:50 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:34:50 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk"/>
Nov 28 18:34:50 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:34:50 user nova-compute[75203]:     </disk>
Nov 28 18:34:50 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:34:50 user nova-compute[75203]:       <mac address="fa:16:3e:b7:c0:ba"/>
Nov 28 18:34:50 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:50 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:34:50 user nova-compute[75203]:       <target dev="tap376d8ef0-5e"/>
Nov 28 18:34:50 user nova-compute[75203]:     </interface>
Nov 28 18:34:50 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:34:50 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/console.log" append="off"/>
Nov 28 18:34:50 user nova-compute[75203]:     </serial>
Nov 28 18:34:50 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:34:50 user nova-compute[75203]:     <video>
Nov 28 18:34:50 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:50 user nova-compute[75203]:     </video>
Nov 28 18:34:50 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:34:50 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:34:50 user nova-compute[75203]:     </rng>
Nov 28 18:34:50 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:34:50 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:34:50 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:34:50 user nova-compute[75203]:     </memballoon>
Nov 28 18:34:50 user nova-compute[75203]:   </devices>
Nov 28 18:34:50 user nova-compute[75203]: </domain>
Nov 28 18:34:50 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1537440989',display_name='tempest-DeleteServersTestJSON-server-1537440989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1537440989',id=1,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98c3564b61b84ad18e5a52b5a83db952',ramdisk_id='',reservation_id='r-r0o4bs6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1581373654',owner_user_name='tempest-DeleteServersTestJSON-1581373654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:43Z,user_data=None,user_id='0c13aa85b0714209b9d5a36b1356b596',uuid=b48f122d-af9c-400c-8a7a-0c1303cc0cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Converting VIF {"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:ba,bridge_name='br-int',has_traffic_filtering=True,id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1,network=Network(80b9ac5a-b87d-45fa-b187-1c2edb345f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376d8ef0-5e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG os_vif [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:ba,bridge_name='br-int',has_traffic_filtering=True,id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1,network=Network(80b9ac5a-b87d-45fa-b187-1c2edb345f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376d8ef0-5e') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Created schema index Interface.name {{(pid=75203) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Created schema index Port.name {{(pid=75203) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Created schema index Bridge.name {{(pid=75203) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Successfully updated port: e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [POLLOUT] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquired lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f631635-edb5-5618-ad9f-966f22e42271', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:50 user nova-compute[75203]: INFO oslo.privsep.daemon [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpj5ahoop6/privsep.sock']
Nov 28 18:34:50 user sudo[84623]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpj5ahoop6/privsep.sock
Nov 28 18:34:50 user sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updating instance_info_cache with network_info: [{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance network_info: |[{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Start _get_guest_xml network_info=[{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:34:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:34:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1112017727',display_name='tempest-ServerRescueNegativeTestJSON-server-1112017727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1112017727',id=3,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-39ifyl7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:45Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=017ccf79-0df6-4fb7-a551-0b67f8e6afe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'pci_devices' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:34:51 user nova-compute[75203]:   <uuid>017ccf79-0df6-4fb7-a551-0b67f8e6afe3</uuid>
Nov 28 18:34:51 user nova-compute[75203]:   <name>instance-00000003</name>
Nov 28 18:34:51 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:34:51 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:34:51 user nova-compute[75203]:   <metadata>
Nov 28 18:34:51 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:34:51 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1112017727</nova:name>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:34:50</nova:creationTime>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:34:51 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:owner>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:user uuid="f96761cb11ad45b0bbc9a0435d3c0324">tempest-ServerRescueNegativeTestJSON-2096861107-project-member</nova:user>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:project uuid="13d19b759f9948c9be9be5097069099b">tempest-ServerRescueNegativeTestJSON-2096861107</nova:project>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:owner>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:ports>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:port uuid="e4a48b3f-3cd4-47b0-afa2-57e955dceeff">
Nov 28 18:34:51 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:34:51 user nova-compute[75203]:         </nova:port>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:ports>
Nov 28 18:34:51 user nova-compute[75203]:     </nova:instance>
Nov 28 18:34:51 user nova-compute[75203]:   </metadata>
Nov 28 18:34:51 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:34:51 user nova-compute[75203]:     <system>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="serial">017ccf79-0df6-4fb7-a551-0b67f8e6afe3</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="uuid">017ccf79-0df6-4fb7-a551-0b67f8e6afe3</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:34:51 user nova-compute[75203]:     </system>
Nov 28 18:34:51 user nova-compute[75203]:   </sysinfo>
Nov 28 18:34:51 user nova-compute[75203]:   <os>
Nov 28 18:34:51 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:34:51 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:34:51 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:34:51 user nova-compute[75203]:   </os>
Nov 28 18:34:51 user nova-compute[75203]:   <features>
Nov 28 18:34:51 user nova-compute[75203]:     <acpi/>
Nov 28 18:34:51 user nova-compute[75203]:     <apic/>
Nov 28 18:34:51 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:34:51 user nova-compute[75203]:   </features>
Nov 28 18:34:51 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:34:51 user nova-compute[75203]:   </clock>
Nov 28 18:34:51 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:34:51 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:34:51 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:34:51 user nova-compute[75203]:   </cpu>
Nov 28 18:34:51 user nova-compute[75203]:   <devices>
Nov 28 18:34:51 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:34:51 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:34:51 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk"/>
Nov 28 18:34:51 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:     </disk>
Nov 28 18:34:51 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:34:51 user nova-compute[75203]:       <mac address="fa:16:3e:f4:cf:2b"/>
Nov 28 18:34:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:34:51 user nova-compute[75203]:       <target dev="tape4a48b3f-3c"/>
Nov 28 18:34:51 user nova-compute[75203]:     </interface>
Nov 28 18:34:51 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:34:51 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/console.log" append="off"/>
Nov 28 18:34:51 user nova-compute[75203]:     </serial>
Nov 28 18:34:51 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:34:51 user nova-compute[75203]:     <video>
Nov 28 18:34:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:     </video>
Nov 28 18:34:51 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:34:51 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:34:51 user nova-compute[75203]:     </rng>
Nov 28 18:34:51 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:34:51 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:34:51 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:34:51 user nova-compute[75203]:     </memballoon>
Nov 28 18:34:51 user nova-compute[75203]:   </devices>
Nov 28 18:34:51 user nova-compute[75203]: </domain>
Nov 28 18:34:51 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1112017727',display_name='tempest-ServerRescueNegativeTestJSON-server-1112017727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1112017727',id=3,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-39ifyl7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:45Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=017ccf79-0df6-4fb7-a551-0b67f8e6afe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG os_vif [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cf6407f-aa97-5a79-967e-b2522178bd5c', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance network_info: |[{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] Acquired lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Refreshing network info cache for port 26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Start _get_guest_xml network_info=[{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:34:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-681958282',display_name='tempest-ServerRescueNegativeTestJSON-server-681958282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-681958282',id=2,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-6bb15uyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:44Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=fafd72ff-f097-4605-b7d5-c4d68ca082dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'pci_devices' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updated VIF entry in instance network info cache for port 376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updating instance_info_cache with network_info: [{"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:34:51 user nova-compute[75203]:   <uuid>fafd72ff-f097-4605-b7d5-c4d68ca082dc</uuid>
Nov 28 18:34:51 user nova-compute[75203]:   <name>instance-00000002</name>
Nov 28 18:34:51 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:34:51 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:34:51 user nova-compute[75203]:   <metadata>
Nov 28 18:34:51 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:34:51 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-681958282</nova:name>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:34:51</nova:creationTime>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:34:51 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:owner>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:user uuid="f96761cb11ad45b0bbc9a0435d3c0324">tempest-ServerRescueNegativeTestJSON-2096861107-project-member</nova:user>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:project uuid="13d19b759f9948c9be9be5097069099b">tempest-ServerRescueNegativeTestJSON-2096861107</nova:project>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:owner>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:ports>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:port uuid="26a39e18-8e9a-4f09-93f5-bc59364ca68e">
Nov 28 18:34:51 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 18:34:51 user nova-compute[75203]:         </nova:port>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:ports>
Nov 28 18:34:51 user nova-compute[75203]:     </nova:instance>
Nov 28 18:34:51 user nova-compute[75203]:   </metadata>
Nov 28 18:34:51 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:34:51 user nova-compute[75203]:     <system>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="serial">fafd72ff-f097-4605-b7d5-c4d68ca082dc</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="uuid">fafd72ff-f097-4605-b7d5-c4d68ca082dc</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:34:51 user nova-compute[75203]:     </system>
Nov 28 18:34:51 user nova-compute[75203]:   </sysinfo>
Nov 28 18:34:51 user nova-compute[75203]:   <os>
Nov 28 18:34:51 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:34:51 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:34:51 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:34:51 user nova-compute[75203]:   </os>
Nov 28 18:34:51 user nova-compute[75203]:   <features>
Nov 28 18:34:51 user nova-compute[75203]:     <acpi/>
Nov 28 18:34:51 user nova-compute[75203]:     <apic/>
Nov 28 18:34:51 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:34:51 user nova-compute[75203]:   </features>
Nov 28 18:34:51 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:34:51 user nova-compute[75203]:   </clock>
Nov 28 18:34:51 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:34:51 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:34:51 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:34:51 user nova-compute[75203]:   </cpu>
Nov 28 18:34:51 user nova-compute[75203]:   <devices>
Nov 28 18:34:51 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:34:51 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:34:51 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk"/>
Nov 28 18:34:51 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:     </disk>
Nov 28 18:34:51 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:34:51 user nova-compute[75203]:       <mac address="fa:16:3e:9f:e1:f0"/>
Nov 28 18:34:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:34:51 user nova-compute[75203]:       <target dev="tap26a39e18-8e"/>
Nov 28 18:34:51 user nova-compute[75203]:     </interface>
Nov 28 18:34:51 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:34:51 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/console.log" append="off"/>
Nov 28 18:34:51 user nova-compute[75203]:     </serial>
Nov 28 18:34:51 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:34:51 user nova-compute[75203]:     <video>
Nov 28 18:34:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:     </video>
Nov 28 18:34:51 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:34:51 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:34:51 user nova-compute[75203]:     </rng>
Nov 28 18:34:51 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:34:51 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:34:51 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:34:51 user nova-compute[75203]:     </memballoon>
Nov 28 18:34:51 user nova-compute[75203]:   </devices>
Nov 28 18:34:51 user nova-compute[75203]: </domain>
Nov 28 18:34:51 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-681958282',display_name='tempest-ServerRescueNegativeTestJSON-server-681958282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-681958282',id=2,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-6bb15uyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:44Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=fafd72ff-f097-4605-b7d5-c4d68ca082dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG os_vif [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '199719e2-b2ca-5f61-8965-ce2b066f27ee', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dc69bf38-3503-46f5-828d-893ccb086486 req-bdcd4d76-0dae-46db-bc07-73d3e7525bef service nova] Releasing lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Releasing lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance network_info: |[{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Start _get_guest_xml network_info=[{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:34:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-872100218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-872100218',id=4,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4nvbQKLZQHRXKnK4UKQ2N+ciJKLOfdYfF6uSAvLxkWJ4TI1FW+az8XSi54TcE8d2ZxjUPaFAgAgJumTuo0TPmO2dM7yE+IjdzwaqHTdjjZ++KmaUHb3+BF40h8hxTZuQ==',key_name='tempest-keypair-1052442870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-bvmbn55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=55c0f8b3-b64d-43d0-9245-730ee9f836fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'pci_devices' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:34:51 user nova-compute[75203]:   <uuid>55c0f8b3-b64d-43d0-9245-730ee9f836fb</uuid>
Nov 28 18:34:51 user nova-compute[75203]:   <name>instance-00000004</name>
Nov 28 18:34:51 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:34:51 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:34:51 user nova-compute[75203]:   <metadata>
Nov 28 18:34:51 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:34:51 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-872100218</nova:name>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:34:51</nova:creationTime>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:34:51 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:owner>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:user uuid="c1a7cdac05464b9ca3ef185aafe6ea0d">tempest-AttachVolumeShelveTestJSON-1995055501-project-member</nova:user>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:project uuid="39b4d281e6da4779a68b17ecd896e6a2">tempest-AttachVolumeShelveTestJSON-1995055501</nova:project>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:owner>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:34:51 user nova-compute[75203]:       <nova:ports>
Nov 28 18:34:51 user nova-compute[75203]:         <nova:port uuid="e926ef4f-c658-45e4-9a84-0368130c6bcb">
Nov 28 18:34:51 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 18:34:51 user nova-compute[75203]:         </nova:port>
Nov 28 18:34:51 user nova-compute[75203]:       </nova:ports>
Nov 28 18:34:51 user nova-compute[75203]:     </nova:instance>
Nov 28 18:34:51 user nova-compute[75203]:   </metadata>
Nov 28 18:34:51 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:34:51 user nova-compute[75203]:     <system>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="serial">55c0f8b3-b64d-43d0-9245-730ee9f836fb</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="uuid">55c0f8b3-b64d-43d0-9245-730ee9f836fb</entry>
Nov 28 18:34:51 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:34:51 user nova-compute[75203]:     </system>
Nov 28 18:34:51 user nova-compute[75203]:   </sysinfo>
Nov 28 18:34:51 user nova-compute[75203]:   <os>
Nov 28 18:34:51 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:34:51 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:34:51 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:34:51 user nova-compute[75203]:   </os>
Nov 28 18:34:51 user nova-compute[75203]:   <features>
Nov 28 18:34:51 user nova-compute[75203]:     <acpi/>
Nov 28 18:34:51 user nova-compute[75203]:     <apic/>
Nov 28 18:34:51 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:34:51 user nova-compute[75203]:   </features>
Nov 28 18:34:51 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:34:51 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:34:51 user nova-compute[75203]:   </clock>
Nov 28 18:34:51 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:34:51 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:34:51 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:34:51 user nova-compute[75203]:   </cpu>
Nov 28 18:34:51 user nova-compute[75203]:   <devices>
Nov 28 18:34:51 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:34:51 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:34:51 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk"/>
Nov 28 18:34:51 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:     </disk>
Nov 28 18:34:51 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:34:51 user nova-compute[75203]:       <mac address="fa:16:3e:c0:7c:67"/>
Nov 28 18:34:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:34:51 user nova-compute[75203]:       <target dev="tape926ef4f-c6"/>
Nov 28 18:34:51 user nova-compute[75203]:     </interface>
Nov 28 18:34:51 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:34:51 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/console.log" append="off"/>
Nov 28 18:34:51 user nova-compute[75203]:     </serial>
Nov 28 18:34:51 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:34:51 user nova-compute[75203]:     <video>
Nov 28 18:34:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:51 user nova-compute[75203]:     </video>
Nov 28 18:34:51 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:34:51 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:34:51 user nova-compute[75203]:     </rng>
Nov 28 18:34:51 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:34:51 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:34:51 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:34:51 user nova-compute[75203]:     </memballoon>
Nov 28 18:34:51 user nova-compute[75203]:   </devices>
Nov 28 18:34:51 user nova-compute[75203]: </domain>
Nov 28 18:34:51 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-872100218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-872100218',id=4,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4nvbQKLZQHRXKnK4UKQ2N+ciJKLOfdYfF6uSAvLxkWJ4TI1FW+az8XSi54TcE8d2ZxjUPaFAgAgJumTuo0TPmO2dM7yE+IjdzwaqHTdjjZ++KmaUHb3+BF40h8hxTZuQ==',key_name='tempest-keypair-1052442870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-bvmbn55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=55c0f8b3-b64d-43d0-9245-730ee9f836fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG os_vif [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb4f5595-3e10-5db9-9d62-f068a81159ae', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-changed-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Refreshing instance network info cache due to event network-changed-e4a48b3f-3cd4-47b0-afa2-57e955dceeff. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] Acquiring lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] Acquired lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Refreshing network info cache for port e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:34:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Successfully created port: 697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:34:52 user sudo[84623]: pam_unix(sudo:session): session closed for user root
Nov 28 18:34:52 user nova-compute[75203]: INFO oslo.privsep.daemon [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Spawned new privsep daemon via rootwrap
Nov 28 18:34:52 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 18:34:52 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 18:34:52 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 28 18:34:52 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84628
Nov 28 18:34:52 user nova-compute[75203]: WARNING oslo_privsep.priv_context [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] privsep daemon already running
Nov 28 18:34:52 user nova-compute[75203]: WARNING oslo_privsep.priv_context [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] privsep daemon already running
Nov 28 18:34:52 user nova-compute[75203]: WARNING oslo_privsep.priv_context [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] privsep daemon already running
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updated VIF entry in instance network info cache for port e4a48b3f-3cd4-47b0-afa2-57e955dceeff. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updating instance_info_cache with network_info: [{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] Releasing lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-changed-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Refreshing instance network info cache due to event network-changed-e926ef4f-c658-45e4-9a84-0368130c6bcb. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] Acquiring lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] Acquired lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Refreshing network info cache for port e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4a48b3f-3c, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4a48b3f-3c, col_values=(('qos', UUID('822e4f53-dc5b-40f7-9f73-79be8b9a30ca')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4a48b3f-3c, col_values=(('external_ids', {'iface-id': 'e4a48b3f-3cd4-47b0-afa2-57e955dceeff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:cf:2b', 'vm-uuid': '017ccf79-0df6-4fb7-a551-0b67f8e6afe3'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: INFO os_vif [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c')
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape926ef4f-c6, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape926ef4f-c6, col_values=(('qos', UUID('ea1677a2-7204-43c1-bc8f-1cb3a1b242c1')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape926ef4f-c6, col_values=(('external_ids', {'iface-id': 'e926ef4f-c658-45e4-9a84-0368130c6bcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:7c:67', 'vm-uuid': '55c0f8b3-b64d-43d0-9245-730ee9f836fb'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: INFO os_vif [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6')
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26a39e18-8e, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26a39e18-8e, col_values=(('qos', UUID('034dd77d-6518-4db1-97ed-0113fbe448f3')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26a39e18-8e, col_values=(('external_ids', {'iface-id': '26a39e18-8e9a-4f09-93f5-bc59364ca68e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:e1:f0', 'vm-uuid': 'fafd72ff-f097-4605-b7d5-c4d68ca082dc'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No VIF found with MAC fa:16:3e:f4:cf:2b, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: INFO os_vif [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e')
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap376d8ef0-5e, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap376d8ef0-5e, col_values=(('qos', UUID('75fb30eb-b936-4ae0-a9e9-26d60d04fedb')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap376d8ef0-5e, col_values=(('external_ids', {'iface-id': '376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:c0:ba', 'vm-uuid': 'b48f122d-af9c-400c-8a7a-0c1303cc0cb8'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No VIF found with MAC fa:16:3e:c0:7c:67, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:52 user nova-compute[75203]: INFO os_vif [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c0:ba,bridge_name='br-int',has_traffic_filtering=True,id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1,network=Network(80b9ac5a-b87d-45fa-b187-1c2edb345f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376d8ef0-5e')
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No VIF found with MAC fa:16:3e:9f:e1:f0, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:34:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] No VIF found with MAC fa:16:3e:b7:c0:ba, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updated VIF entry in instance network info cache for port e926ef4f-c658-45e4-9a84-0368130c6bcb. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bebe2e8e-b71e-4ba2-9157-27ab72a96489 req-456b8a93-aca7-46bc-ad0e-59dab172d730 service nova] Releasing lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updated VIF entry in instance network info cache for port 26a39e18-8e9a-4f09-93f5-bc59364ca68e. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ee020778-8200-4082-8cd5-9189ba1acbc1 req-2c8d4f47-089e-4195-a1be-45ebedde071e service nova] Releasing lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Successfully updated port: 697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquired lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-changed-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Refreshing instance network info cache due to event network-changed-697e8d57-71b4-41ea-87e0-507601444786. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] Acquiring lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Releasing lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Instance network_info: |[{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] Acquired lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Refreshing network info cache for port 697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Start _get_guest_xml network_info=[{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:34:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1729216457',display_name='tempest-ServerActionsTestOtherA-server-1729216457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1729216457',id=5,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvi68p7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=4382dd69-a9f8-45a8-ae99-78d295cb606f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=697e8d57-71b4-41ea-87e0-507601444786,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697e8d57-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'pci_devices' on Instance uuid 4382dd69-a9f8-45a8-ae99-78d295cb606f {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:34:54 user nova-compute[75203]:   <uuid>4382dd69-a9f8-45a8-ae99-78d295cb606f</uuid>
Nov 28 18:34:54 user nova-compute[75203]:   <name>instance-00000005</name>
Nov 28 18:34:54 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:34:54 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:34:54 user nova-compute[75203]:   <metadata>
Nov 28 18:34:54 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:34:54 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:34:54 user nova-compute[75203]:       <nova:name>tempest-ServerActionsTestOtherA-server-1729216457</nova:name>
Nov 28 18:34:54 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:34:54</nova:creationTime>
Nov 28 18:34:54 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:34:54 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:34:54 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:34:54 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:34:54 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:34:54 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:34:54 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:34:54 user nova-compute[75203]:       <nova:owner>
Nov 28 18:34:54 user nova-compute[75203]:         <nova:user uuid="4b7ea4623ff14b2ea244c31ac84dd600">tempest-ServerActionsTestOtherA-1893596751-project-member</nova:user>
Nov 28 18:34:54 user nova-compute[75203]:         <nova:project uuid="974923cb2e06473bbd8e4122888494df">tempest-ServerActionsTestOtherA-1893596751</nova:project>
Nov 28 18:34:54 user nova-compute[75203]:       </nova:owner>
Nov 28 18:34:54 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:34:54 user nova-compute[75203]:       <nova:ports>
Nov 28 18:34:54 user nova-compute[75203]:         <nova:port uuid="697e8d57-71b4-41ea-87e0-507601444786">
Nov 28 18:34:54 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 18:34:54 user nova-compute[75203]:         </nova:port>
Nov 28 18:34:54 user nova-compute[75203]:       </nova:ports>
Nov 28 18:34:54 user nova-compute[75203]:     </nova:instance>
Nov 28 18:34:54 user nova-compute[75203]:   </metadata>
Nov 28 18:34:54 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:34:54 user nova-compute[75203]:     <system>
Nov 28 18:34:54 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:34:54 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:34:54 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:34:54 user nova-compute[75203]:       <entry name="serial">4382dd69-a9f8-45a8-ae99-78d295cb606f</entry>
Nov 28 18:34:54 user nova-compute[75203]:       <entry name="uuid">4382dd69-a9f8-45a8-ae99-78d295cb606f</entry>
Nov 28 18:34:54 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:34:54 user nova-compute[75203]:     </system>
Nov 28 18:34:54 user nova-compute[75203]:   </sysinfo>
Nov 28 18:34:54 user nova-compute[75203]:   <os>
Nov 28 18:34:54 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:34:54 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:34:54 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:34:54 user nova-compute[75203]:   </os>
Nov 28 18:34:54 user nova-compute[75203]:   <features>
Nov 28 18:34:54 user nova-compute[75203]:     <acpi/>
Nov 28 18:34:54 user nova-compute[75203]:     <apic/>
Nov 28 18:34:54 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:34:54 user nova-compute[75203]:   </features>
Nov 28 18:34:54 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:34:54 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:34:54 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:34:54 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:34:54 user nova-compute[75203]:   </clock>
Nov 28 18:34:54 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:34:54 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:34:54 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:34:54 user nova-compute[75203]:   </cpu>
Nov 28 18:34:54 user nova-compute[75203]:   <devices>
Nov 28 18:34:54 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:34:54 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:34:54 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk"/>
Nov 28 18:34:54 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:34:54 user nova-compute[75203]:     </disk>
Nov 28 18:34:54 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:34:54 user nova-compute[75203]:       <mac address="fa:16:3e:69:e4:8d"/>
Nov 28 18:34:54 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:54 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:34:54 user nova-compute[75203]:       <target dev="tap697e8d57-71"/>
Nov 28 18:34:54 user nova-compute[75203]:     </interface>
Nov 28 18:34:54 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:34:54 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/console.log" append="off"/>
Nov 28 18:34:54 user nova-compute[75203]:     </serial>
Nov 28 18:34:54 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:34:54 user nova-compute[75203]:     <video>
Nov 28 18:34:54 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:34:54 user nova-compute[75203]:     </video>
Nov 28 18:34:54 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:34:54 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:34:54 user nova-compute[75203]:     </rng>
Nov 28 18:34:54 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:34:54 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:34:54 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:34:54 user nova-compute[75203]:     </memballoon>
Nov 28 18:34:54 user nova-compute[75203]:   </devices>
Nov 28 18:34:54 user nova-compute[75203]: </domain>
Nov 28 18:34:54 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1729216457',display_name='tempest-ServerActionsTestOtherA-server-1729216457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1729216457',id=5,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvi68p7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:34:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=4382dd69-a9f8-45a8-ae99-78d295cb606f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=697e8d57-71b4-41ea-87e0-507601444786,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697e8d57-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG os_vif [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=697e8d57-71b4-41ea-87e0-507601444786,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697e8d57-71') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3697aed-aba6-5dbe-9809-f19979327c12', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap697e8d57-71, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap697e8d57-71, col_values=(('qos', UUID('4e22854d-665e-425d-9a57-a51db74ee3ce')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap697e8d57-71, col_values=(('external_ids', {'iface-id': '697e8d57-71b4-41ea-87e0-507601444786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:e4:8d', 'vm-uuid': '4382dd69-a9f8-45a8-ae99-78d295cb606f'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:34:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:34:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:55 user nova-compute[75203]: INFO os_vif [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=697e8d57-71b4-41ea-87e0-507601444786,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697e8d57-71')
Nov 28 18:34:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:34:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No VIF found with MAC fa:16:3e:69:e4:8d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:34:55 user nova-compute[75203]: DEBUG nova.network.neutron [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updated VIF entry in instance network info cache for port 697e8d57-71b4-41ea-87e0-507601444786. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:34:55 user nova-compute[75203]: DEBUG nova.network.neutron [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:34:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-26416734-b643-40cf-aed5-5970b98951af req-b8d8d663-6fcf-4cc6-beef-4e5a12d71898 service nova] Releasing lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:34:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-1d3e1c1f-125a-497d-ba3d-c2a4f2a33136 req-eca3081b-09fe-4cf4-b340-afc7517f1e6f service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received event network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1d3e1c1f-125a-497d-ba3d-c2a4f2a33136 req-eca3081b-09fe-4cf4-b340-afc7517f1e6f service nova] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1d3e1c1f-125a-497d-ba3d-c2a4f2a33136 req-eca3081b-09fe-4cf4-b340-afc7517f1e6f service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1d3e1c1f-125a-497d-ba3d-c2a4f2a33136 req-eca3081b-09fe-4cf4-b340-afc7517f1e6f service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:34:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-1d3e1c1f-125a-497d-ba3d-c2a4f2a33136 req-eca3081b-09fe-4cf4-b340-afc7517f1e6f service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] No waiting events found dispatching network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:34:59 user nova-compute[75203]: WARNING nova.compute.manager [req-1d3e1c1f-125a-497d-ba3d-c2a4f2a33136 req-eca3081b-09fe-4cf4-b340-afc7517f1e6f service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received unexpected event network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 for instance with vm_state building and task_state spawning.
Nov 28 18:34:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-8a671c3c-90cb-44ed-8d9c-e98ed091502a req-c6a83e1b-2617-4d95-b69e-85b5af9d8634 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received event network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8a671c3c-90cb-44ed-8d9c-e98ed091502a req-c6a83e1b-2617-4d95-b69e-85b5af9d8634 service nova] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8a671c3c-90cb-44ed-8d9c-e98ed091502a req-c6a83e1b-2617-4d95-b69e-85b5af9d8634 service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8a671c3c-90cb-44ed-8d9c-e98ed091502a req-c6a83e1b-2617-4d95-b69e-85b5af9d8634 service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-8a671c3c-90cb-44ed-8d9c-e98ed091502a req-c6a83e1b-2617-4d95-b69e-85b5af9d8634 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] No waiting events found dispatching network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:01 user nova-compute[75203]: WARNING nova.compute.manager [req-8a671c3c-90cb-44ed-8d9c-e98ed091502a req-c6a83e1b-2617-4d95-b69e-85b5af9d8634 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received unexpected event network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 for instance with vm_state building and task_state spawning.
Nov 28 18:35:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:35:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.compute.claims [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Claim successful on node user
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Instance spawned successfully.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance spawned successfully.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Instance spawned successfully.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance spawned successfully.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance spawned successfully.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Took 18.35 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Took 20.77 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Took 15.56 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Took 18.90 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:03 user nova-compute[75203]: INFO nova.compute.manager [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Took 20.09 seconds to build instance.
Nov 28 18:35:04 user nova-compute[75203]: INFO nova.compute.manager [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Took 22.10 seconds to build instance.
Nov 28 18:35:04 user nova-compute[75203]: INFO nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Took 20.32 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d31d157a-027a-4d2a-b368-b226d3cec43e tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.411s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:04 user nova-compute[75203]: INFO nova.compute.manager [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Took 19.97 seconds to build instance.
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44e408bb-69f3-461d-a17c-6133b863b89d tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.558s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:04 user nova-compute[75203]: INFO nova.compute.manager [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Took 21.90 seconds to build instance.
Nov 28 18:35:04 user nova-compute[75203]: INFO nova.compute.manager [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Took 16.99 seconds to build instance.
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3d0a54bc-c7e9-462f-868e-fa937e05b754 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.250s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8133186-2175-4289-94cf-99041641f04e tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.372s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e36dac1-dabd-415e-aa02-c2b25092ee9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.293s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.970s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:35:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:35:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG nova.policy [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0bbf1727aff4c61b80cc15f640a20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2feb0fa92b6443b1afa886bfd04e7f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:35:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Creating image(s)
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "/opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "/opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "/opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:35:05 user nova-compute[75203]: INFO nova.compute.claims [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Claim successful on node user
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.262s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.356s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk 1073741824" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.535s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.011s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Successfully created port: 5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.292s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Cannot resize image /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Ensure instance console log exists: /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.policy [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc96b524e90a410f9a65b45d5bde199b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0590833de314f11b36a7cb7c5b23635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:35:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Creating image(s)
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "/opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "/opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "/opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.313s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.256s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk 1073741824" returned: 0 in 0.099s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.301s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:35:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Cannot resize image /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Ensure instance console log exists: /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Successfully updated port: 5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquired lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Successfully created port: d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-changed-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Refreshing instance network info cache due to event network-changed-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] Acquiring lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updating instance_info_cache with network_info: [{"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Releasing lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Instance network_info: |[{"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] Acquired lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.network.neutron [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Refreshing network info cache for port 5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Start _get_guest_xml network_info=[{"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:35:10 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:10 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1765760766',display_name='tempest-VolumesAdminNegativeTest-server-1765760766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1765760766',id=6,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0FbE9rTgIvG09DgEacIaGZ6yoMjlK3ZNCO9BL5YKOXc6zuwAHoutTz3pABzwnshx7ofiLq94i7cQdty0eZ16xbg5A77Pwg1Alo4APIx1+x0jsehHoKicUcie17NMDDPA==',key_name='tempest-keypair-1436859568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2feb0fa92b6443b1afa886bfd04e7f80',ramdisk_id='',reservation_id='r-lbn6h2n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1771058656',owner_user_name='tempest-VolumesAdminNegativeTest-1771058656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bbf1727aff4c61b80cc15f640a20f6',uuid=b44f50fc-d483-4a67-8fd1-7146a3d0adbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converting VIF {"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:14,bridge_name='br-int',has_traffic_filtering=True,id=5718ecd4-ded7-4efb-84a1-a0cfe3fabef3,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5718ecd4-de') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.objects.instance [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lazy-loading 'pci_devices' on Instance uuid b44f50fc-d483-4a67-8fd1-7146a3d0adbd {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:35:10 user nova-compute[75203]:   <uuid>b44f50fc-d483-4a67-8fd1-7146a3d0adbd</uuid>
Nov 28 18:35:10 user nova-compute[75203]:   <name>instance-00000006</name>
Nov 28 18:35:10 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:35:10 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:35:10 user nova-compute[75203]:   <metadata>
Nov 28 18:35:10 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:35:10 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:35:10 user nova-compute[75203]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1765760766</nova:name>
Nov 28 18:35:10 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:35:10</nova:creationTime>
Nov 28 18:35:10 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:35:10 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:35:10 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:35:10 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:35:10 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:35:10 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:35:10 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:35:10 user nova-compute[75203]:       <nova:owner>
Nov 28 18:35:10 user nova-compute[75203]:         <nova:user uuid="b0bbf1727aff4c61b80cc15f640a20f6">tempest-VolumesAdminNegativeTest-1771058656-project-member</nova:user>
Nov 28 18:35:10 user nova-compute[75203]:         <nova:project uuid="2feb0fa92b6443b1afa886bfd04e7f80">tempest-VolumesAdminNegativeTest-1771058656</nova:project>
Nov 28 18:35:10 user nova-compute[75203]:       </nova:owner>
Nov 28 18:35:10 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:35:10 user nova-compute[75203]:       <nova:ports>
Nov 28 18:35:10 user nova-compute[75203]:         <nova:port uuid="5718ecd4-ded7-4efb-84a1-a0cfe3fabef3">
Nov 28 18:35:10 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 18:35:10 user nova-compute[75203]:         </nova:port>
Nov 28 18:35:10 user nova-compute[75203]:       </nova:ports>
Nov 28 18:35:10 user nova-compute[75203]:     </nova:instance>
Nov 28 18:35:10 user nova-compute[75203]:   </metadata>
Nov 28 18:35:10 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:35:10 user nova-compute[75203]:     <system>
Nov 28 18:35:10 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:35:10 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:35:10 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:35:10 user nova-compute[75203]:       <entry name="serial">b44f50fc-d483-4a67-8fd1-7146a3d0adbd</entry>
Nov 28 18:35:10 user nova-compute[75203]:       <entry name="uuid">b44f50fc-d483-4a67-8fd1-7146a3d0adbd</entry>
Nov 28 18:35:10 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:35:10 user nova-compute[75203]:     </system>
Nov 28 18:35:10 user nova-compute[75203]:   </sysinfo>
Nov 28 18:35:10 user nova-compute[75203]:   <os>
Nov 28 18:35:10 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:35:10 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:35:10 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:35:10 user nova-compute[75203]:   </os>
Nov 28 18:35:10 user nova-compute[75203]:   <features>
Nov 28 18:35:10 user nova-compute[75203]:     <acpi/>
Nov 28 18:35:10 user nova-compute[75203]:     <apic/>
Nov 28 18:35:10 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:35:10 user nova-compute[75203]:   </features>
Nov 28 18:35:10 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:35:10 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:35:10 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:35:10 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:35:10 user nova-compute[75203]:   </clock>
Nov 28 18:35:10 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:35:10 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:35:10 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:35:10 user nova-compute[75203]:   </cpu>
Nov 28 18:35:10 user nova-compute[75203]:   <devices>
Nov 28 18:35:10 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:35:10 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:35:10 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk"/>
Nov 28 18:35:10 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:35:10 user nova-compute[75203]:     </disk>
Nov 28 18:35:10 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:35:10 user nova-compute[75203]:       <mac address="fa:16:3e:16:4d:14"/>
Nov 28 18:35:10 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:10 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:35:10 user nova-compute[75203]:       <target dev="tap5718ecd4-de"/>
Nov 28 18:35:10 user nova-compute[75203]:     </interface>
Nov 28 18:35:10 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:35:10 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/console.log" append="off"/>
Nov 28 18:35:10 user nova-compute[75203]:     </serial>
Nov 28 18:35:10 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:35:10 user nova-compute[75203]:     <video>
Nov 28 18:35:10 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:10 user nova-compute[75203]:     </video>
Nov 28 18:35:10 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:35:10 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:35:10 user nova-compute[75203]:     </rng>
Nov 28 18:35:10 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:35:10 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:35:10 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:35:10 user nova-compute[75203]:     </memballoon>
Nov 28 18:35:10 user nova-compute[75203]:   </devices>
Nov 28 18:35:10 user nova-compute[75203]: </domain>
Nov 28 18:35:10 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1765760766',display_name='tempest-VolumesAdminNegativeTest-server-1765760766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1765760766',id=6,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0FbE9rTgIvG09DgEacIaGZ6yoMjlK3ZNCO9BL5YKOXc6zuwAHoutTz3pABzwnshx7ofiLq94i7cQdty0eZ16xbg5A77Pwg1Alo4APIx1+x0jsehHoKicUcie17NMDDPA==',key_name='tempest-keypair-1436859568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2feb0fa92b6443b1afa886bfd04e7f80',ramdisk_id='',reservation_id='r-lbn6h2n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1771058656',owner_user_name='tempest-VolumesAdminNegativeTest-1771058656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bbf1727aff4c61b80cc15f640a20f6',uuid=b44f50fc-d483-4a67-8fd1-7146a3d0adbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converting VIF {"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:14,bridge_name='br-int',has_traffic_filtering=True,id=5718ecd4-ded7-4efb-84a1-a0cfe3fabef3,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5718ecd4-de') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG os_vif [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:14,bridge_name='br-int',has_traffic_filtering=True,id=5718ecd4-ded7-4efb-84a1-a0cfe3fabef3,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5718ecd4-de') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cab8724-2881-5cf7-9579-fd177f3b69f9', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5718ecd4-de, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5718ecd4-de, col_values=(('qos', UUID('b8c1d90a-2223-428d-93a1-b25b287fbe5a')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5718ecd4-de, col_values=(('external_ids', {'iface-id': '5718ecd4-ded7-4efb-84a1-a0cfe3fabef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:4d:14', 'vm-uuid': 'b44f50fc-d483-4a67-8fd1-7146a3d0adbd'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:10 user nova-compute[75203]: INFO os_vif [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:14,bridge_name='br-int',has_traffic_filtering=True,id=5718ecd4-ded7-4efb-84a1-a0cfe3fabef3,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5718ecd4-de')
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:35:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] No VIF found with MAC fa:16:3e:16:4d:14, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-9070f795-a42e-4112-8866-0b9bb33a40d6 req-c849a99b-3066-445e-8bbe-bd1b7c7f9df6 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9070f795-a42e-4112-8866-0b9bb33a40d6 req-c849a99b-3066-445e-8bbe-bd1b7c7f9df6 service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9070f795-a42e-4112-8866-0b9bb33a40d6 req-c849a99b-3066-445e-8bbe-bd1b7c7f9df6 service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9070f795-a42e-4112-8866-0b9bb33a40d6 req-c849a99b-3066-445e-8bbe-bd1b7c7f9df6 service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-9070f795-a42e-4112-8866-0b9bb33a40d6 req-c849a99b-3066-445e-8bbe-bd1b7c7f9df6 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:11 user nova-compute[75203]: WARNING nova.compute.manager [req-9070f795-a42e-4112-8866-0b9bb33a40d6 req-c849a99b-3066-445e-8bbe-bd1b7c7f9df6 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received unexpected event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with vm_state active and task_state None.
Nov 28 18:35:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Successfully updated port: d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquired lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-changed-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Refreshing instance network info cache due to event network-changed-d9f83989-3a77-4ca2-90bf-d6485e6999a9. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] Acquiring lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updated VIF entry in instance network info cache for port 5718ecd4-ded7-4efb-84a1-a0cfe3fabef3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updating instance_info_cache with network_info: [{"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-96020cdd-06ed-4eaa-ba2a-d4e773994253 req-328b08a5-4f8f-436a-a719-aadff3fd5ad5 service nova] Releasing lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updating instance_info_cache with network_info: [{"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Releasing lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Instance network_info: |[{"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] Acquired lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Refreshing network info cache for port d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Start _get_guest_xml network_info=[{"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:35:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1847674091',display_name='tempest-TestVolumeSwap-server-1847674091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1847674091',id=7,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyQ+FGzOY5xMvUdQHIWytCdf3TsESC9qLeo+LivEIFB5dE23Smc6nuQdB12nFdvw9/E6QU1UGLLCzjJlxFeYeWWKLvVOiXFP8MQVrNpRIYaR522IvwC22nTQ0seBiTs5Q==',key_name='tempest-keypair-1525821321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0590833de314f11b36a7cb7c5b23635',ramdisk_id='',reservation_id='r-h4wye505',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1702754877',owner_user_name='tempest-TestVolumeSwap-1702754877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc96b524e90a410f9a65b45d5bde199b',uuid=72f841aa-13fb-4373-9225-2df8a700e045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Converting VIF {"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9f83989-3a77-4ca2-90bf-d6485e6999a9,network=Network(2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f83989-3a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lazy-loading 'pci_devices' on Instance uuid 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:35:13 user nova-compute[75203]:   <uuid>72f841aa-13fb-4373-9225-2df8a700e045</uuid>
Nov 28 18:35:13 user nova-compute[75203]:   <name>instance-00000007</name>
Nov 28 18:35:13 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:35:13 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:35:13 user nova-compute[75203]:   <metadata>
Nov 28 18:35:13 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:35:13 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:35:13 user nova-compute[75203]:       <nova:name>tempest-TestVolumeSwap-server-1847674091</nova:name>
Nov 28 18:35:13 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:35:12</nova:creationTime>
Nov 28 18:35:13 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:35:13 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:35:13 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:35:13 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:35:13 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:35:13 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:35:13 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:35:13 user nova-compute[75203]:       <nova:owner>
Nov 28 18:35:13 user nova-compute[75203]:         <nova:user uuid="cc96b524e90a410f9a65b45d5bde199b">tempest-TestVolumeSwap-1702754877-project-member</nova:user>
Nov 28 18:35:13 user nova-compute[75203]:         <nova:project uuid="d0590833de314f11b36a7cb7c5b23635">tempest-TestVolumeSwap-1702754877</nova:project>
Nov 28 18:35:13 user nova-compute[75203]:       </nova:owner>
Nov 28 18:35:13 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:35:13 user nova-compute[75203]:       <nova:ports>
Nov 28 18:35:13 user nova-compute[75203]:         <nova:port uuid="d9f83989-3a77-4ca2-90bf-d6485e6999a9">
Nov 28 18:35:13 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:35:13 user nova-compute[75203]:         </nova:port>
Nov 28 18:35:13 user nova-compute[75203]:       </nova:ports>
Nov 28 18:35:13 user nova-compute[75203]:     </nova:instance>
Nov 28 18:35:13 user nova-compute[75203]:   </metadata>
Nov 28 18:35:13 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:35:13 user nova-compute[75203]:     <system>
Nov 28 18:35:13 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:35:13 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:35:13 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:35:13 user nova-compute[75203]:       <entry name="serial">72f841aa-13fb-4373-9225-2df8a700e045</entry>
Nov 28 18:35:13 user nova-compute[75203]:       <entry name="uuid">72f841aa-13fb-4373-9225-2df8a700e045</entry>
Nov 28 18:35:13 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:35:13 user nova-compute[75203]:     </system>
Nov 28 18:35:13 user nova-compute[75203]:   </sysinfo>
Nov 28 18:35:13 user nova-compute[75203]:   <os>
Nov 28 18:35:13 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:35:13 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:35:13 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:35:13 user nova-compute[75203]:   </os>
Nov 28 18:35:13 user nova-compute[75203]:   <features>
Nov 28 18:35:13 user nova-compute[75203]:     <acpi/>
Nov 28 18:35:13 user nova-compute[75203]:     <apic/>
Nov 28 18:35:13 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:35:13 user nova-compute[75203]:   </features>
Nov 28 18:35:13 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:35:13 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:35:13 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:35:13 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:35:13 user nova-compute[75203]:   </clock>
Nov 28 18:35:13 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:35:13 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:35:13 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:35:13 user nova-compute[75203]:   </cpu>
Nov 28 18:35:13 user nova-compute[75203]:   <devices>
Nov 28 18:35:13 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:35:13 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:35:13 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk"/>
Nov 28 18:35:13 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:35:13 user nova-compute[75203]:     </disk>
Nov 28 18:35:13 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:35:13 user nova-compute[75203]:       <mac address="fa:16:3e:39:a4:8d"/>
Nov 28 18:35:13 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:13 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:35:13 user nova-compute[75203]:       <target dev="tapd9f83989-3a"/>
Nov 28 18:35:13 user nova-compute[75203]:     </interface>
Nov 28 18:35:13 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:35:13 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/console.log" append="off"/>
Nov 28 18:35:13 user nova-compute[75203]:     </serial>
Nov 28 18:35:13 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:35:13 user nova-compute[75203]:     <video>
Nov 28 18:35:13 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:13 user nova-compute[75203]:     </video>
Nov 28 18:35:13 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:35:13 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:35:13 user nova-compute[75203]:     </rng>
Nov 28 18:35:13 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:35:13 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:35:13 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:35:13 user nova-compute[75203]:     </memballoon>
Nov 28 18:35:13 user nova-compute[75203]:   </devices>
Nov 28 18:35:13 user nova-compute[75203]: </domain>
Nov 28 18:35:13 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1847674091',display_name='tempest-TestVolumeSwap-server-1847674091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1847674091',id=7,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyQ+FGzOY5xMvUdQHIWytCdf3TsESC9qLeo+LivEIFB5dE23Smc6nuQdB12nFdvw9/E6QU1UGLLCzjJlxFeYeWWKLvVOiXFP8MQVrNpRIYaR522IvwC22nTQ0seBiTs5Q==',key_name='tempest-keypair-1525821321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0590833de314f11b36a7cb7c5b23635',ramdisk_id='',reservation_id='r-h4wye505',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1702754877',owner_user_name='tempest-TestVolumeSwap-1702754877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc96b524e90a410f9a65b45d5bde199b',uuid=72f841aa-13fb-4373-9225-2df8a700e045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Converting VIF {"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9f83989-3a77-4ca2-90bf-d6485e6999a9,network=Network(2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f83989-3a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG os_vif [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9f83989-3a77-4ca2-90bf-d6485e6999a9,network=Network(2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f83989-3a') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e3ef4de-742a-5c49-afe7-3f4f47bf5bc6', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9f83989-3a, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9f83989-3a, col_values=(('qos', UUID('e5f64251-56f8-4a74-a3d7-1e54825bdfd7')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9f83989-3a, col_values=(('external_ids', {'iface-id': 'd9f83989-3a77-4ca2-90bf-d6485e6999a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:a4:8d', 'vm-uuid': '72f841aa-13fb-4373-9225-2df8a700e045'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:13 user nova-compute[75203]: INFO os_vif [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a4:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9f83989-3a77-4ca2-90bf-d6485e6999a9,network=Network(2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f83989-3a')
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] No VIF found with MAC fa:16:3e:39:a4:8d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:13 user nova-compute[75203]: WARNING nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received unexpected event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with vm_state active and task_state None.
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:13 user nova-compute[75203]: WARNING nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received unexpected event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with vm_state active and task_state None.
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:13 user nova-compute[75203]: WARNING nova.compute.manager [req-e241b088-6182-4705-acc6-ada1644402bc req-384a0ebc-f6b0-4ca6-8d63-f7f03b7dac6e service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received unexpected event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with vm_state active and task_state None.
Nov 28 18:35:14 user nova-compute[75203]: DEBUG nova.network.neutron [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updated VIF entry in instance network info cache for port d9f83989-3a77-4ca2-90bf-d6485e6999a9. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:35:14 user nova-compute[75203]: DEBUG nova.network.neutron [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updating instance_info_cache with network_info: [{"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0eaf6eb7-ea7e-4d5c-b961-070dd878a9dc req-f308cc7b-32bc-419f-a816-ebfeb8732027 service nova] Releasing lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] No waiting events found dispatching network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:15 user nova-compute[75203]: WARNING nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received unexpected event network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 for instance with vm_state active and task_state None.
Nov 28 18:35:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] No waiting events found dispatching network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:15 user nova-compute[75203]: WARNING nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received unexpected event network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 for instance with vm_state active and task_state None.
Nov 28 18:35:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] No waiting events found dispatching network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:15 user nova-compute[75203]: WARNING nova.compute.manager [req-dd1b68e0-6028-481e-b7dd-0e57e75f38a5 req-4decab59-9e5c-4e5f-9f2d-e4746972fa0d service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received unexpected event network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 for instance with vm_state building and task_state spawning.
Nov 28 18:35:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:16 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:35:16 user nova-compute[75203]: INFO nova.compute.claims [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Claim successful on node user
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:35:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.policy [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3684f12fd03a4eeb95b13e13cd21f7a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd291690301244eb495c371c6b5ccc3fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:35:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Creating image(s)
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "/opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "/opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "/opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Instance spawned successfully.
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.249s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-ba004bc7-3c65-495f-8bdf-fd4db00902d9 req-c4b96426-c29f-49e2-9156-13377ca94c16 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ba004bc7-3c65-495f-8bdf-fd4db00902d9 req-c4b96426-c29f-49e2-9156-13377ca94c16 service nova] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ba004bc7-3c65-495f-8bdf-fd4db00902d9 req-c4b96426-c29f-49e2-9156-13377ca94c16 service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ba004bc7-3c65-495f-8bdf-fd4db00902d9 req-c4b96426-c29f-49e2-9156-13377ca94c16 service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-ba004bc7-3c65-495f-8bdf-fd4db00902d9 req-c4b96426-c29f-49e2-9156-13377ca94c16 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] No waiting events found dispatching network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:17 user nova-compute[75203]: WARNING nova.compute.manager [req-ba004bc7-3c65-495f-8bdf-fd4db00902d9 req-c4b96426-c29f-49e2-9156-13377ca94c16 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received unexpected event network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 for instance with vm_state building and task_state spawning.
Nov 28 18:35:18 user nova-compute[75203]: INFO nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Took 12.83 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:18 user nova-compute[75203]: INFO nova.compute.manager [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Took 15.66 seconds to build instance.
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f45c059-c6f9-46db-804d-8c5dfdda52bb tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.798s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.458s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk 1073741824" returned: 0 in 0.094s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.558s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:18 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Instance spawned successfully.
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.263s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:35:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:18 user nova-compute[75203]: INFO nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Took 12.03 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:18 user nova-compute[75203]: INFO nova.compute.manager [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Took 13.79 seconds to build instance.
Nov 28 18:35:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Cannot resize image /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Ensure instance console log exists: /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d2f6d8d-fcd1-439e-ac2f-96a9e1c7fa57 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.203s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Successfully created port: e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Successfully updated port: e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquired lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-changed-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Refreshing instance network info cache due to event network-changed-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] Acquiring lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Updating instance_info_cache with network_info: [{"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Releasing lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Instance network_info: |[{"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] Acquired lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.network.neutron [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Refreshing network info cache for port e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Start _get_guest_xml network_info=[{"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:35:21 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:21 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1275372563',display_name='tempest-VolumesAssistedSnapshotsTest-server-1275372563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1275372563',id=8,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSDKDOyoA50IykOcPcwZMwj1/NCArQSKD9IkTZ49ITJnbiR5BozHbuRb+Vgckj0Qx43iqZGM5cr45WSxOs/m46CDMSjAJHRznXRz7tERn1H167CHLjovYdUsLB67SsRvw==',key_name='tempest-keypair-596320098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d291690301244eb495c371c6b5ccc3fd',ramdisk_id='',reservation_id='r-4yrad7cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1665206057',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1665206057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3684f12fd03a4eeb95b13e13cd21f7a2',uuid=a233bb09-8c6e-44d0-945f-ee219a6e1bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Converting VIF {"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0c81299-ac22-4675-a91b-3e8ce5d9c9ef,network=Network(bfe34745-c11f-46e3-8006-cc78186840fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c81299-ac') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.objects.instance [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lazy-loading 'pci_devices' on Instance uuid a233bb09-8c6e-44d0-945f-ee219a6e1bfa {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:35:21 user nova-compute[75203]:   <uuid>a233bb09-8c6e-44d0-945f-ee219a6e1bfa</uuid>
Nov 28 18:35:21 user nova-compute[75203]:   <name>instance-00000008</name>
Nov 28 18:35:21 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:35:21 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:35:21 user nova-compute[75203]:   <metadata>
Nov 28 18:35:21 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:35:21 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:35:21 user nova-compute[75203]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1275372563</nova:name>
Nov 28 18:35:21 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:35:21</nova:creationTime>
Nov 28 18:35:21 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:35:21 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:35:21 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:35:21 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:35:21 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:35:21 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:35:21 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:35:21 user nova-compute[75203]:       <nova:owner>
Nov 28 18:35:21 user nova-compute[75203]:         <nova:user uuid="3684f12fd03a4eeb95b13e13cd21f7a2">tempest-VolumesAssistedSnapshotsTest-1665206057-project-member</nova:user>
Nov 28 18:35:21 user nova-compute[75203]:         <nova:project uuid="d291690301244eb495c371c6b5ccc3fd">tempest-VolumesAssistedSnapshotsTest-1665206057</nova:project>
Nov 28 18:35:21 user nova-compute[75203]:       </nova:owner>
Nov 28 18:35:21 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:35:21 user nova-compute[75203]:       <nova:ports>
Nov 28 18:35:21 user nova-compute[75203]:         <nova:port uuid="e0c81299-ac22-4675-a91b-3e8ce5d9c9ef">
Nov 28 18:35:21 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 18:35:21 user nova-compute[75203]:         </nova:port>
Nov 28 18:35:21 user nova-compute[75203]:       </nova:ports>
Nov 28 18:35:21 user nova-compute[75203]:     </nova:instance>
Nov 28 18:35:21 user nova-compute[75203]:   </metadata>
Nov 28 18:35:21 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:35:21 user nova-compute[75203]:     <system>
Nov 28 18:35:21 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:35:21 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:35:21 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:35:21 user nova-compute[75203]:       <entry name="serial">a233bb09-8c6e-44d0-945f-ee219a6e1bfa</entry>
Nov 28 18:35:21 user nova-compute[75203]:       <entry name="uuid">a233bb09-8c6e-44d0-945f-ee219a6e1bfa</entry>
Nov 28 18:35:21 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:35:21 user nova-compute[75203]:     </system>
Nov 28 18:35:21 user nova-compute[75203]:   </sysinfo>
Nov 28 18:35:21 user nova-compute[75203]:   <os>
Nov 28 18:35:21 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:35:21 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:35:21 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:35:21 user nova-compute[75203]:   </os>
Nov 28 18:35:21 user nova-compute[75203]:   <features>
Nov 28 18:35:21 user nova-compute[75203]:     <acpi/>
Nov 28 18:35:21 user nova-compute[75203]:     <apic/>
Nov 28 18:35:21 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:35:21 user nova-compute[75203]:   </features>
Nov 28 18:35:21 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:35:21 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:35:21 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:35:21 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:35:21 user nova-compute[75203]:   </clock>
Nov 28 18:35:21 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:35:21 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:35:21 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:35:21 user nova-compute[75203]:   </cpu>
Nov 28 18:35:21 user nova-compute[75203]:   <devices>
Nov 28 18:35:21 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:35:21 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:35:21 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk"/>
Nov 28 18:35:21 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:35:21 user nova-compute[75203]:     </disk>
Nov 28 18:35:21 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:35:21 user nova-compute[75203]:       <mac address="fa:16:3e:8d:68:9d"/>
Nov 28 18:35:21 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:21 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:35:21 user nova-compute[75203]:       <target dev="tape0c81299-ac"/>
Nov 28 18:35:21 user nova-compute[75203]:     </interface>
Nov 28 18:35:21 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:35:21 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/console.log" append="off"/>
Nov 28 18:35:21 user nova-compute[75203]:     </serial>
Nov 28 18:35:21 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:35:21 user nova-compute[75203]:     <video>
Nov 28 18:35:21 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:21 user nova-compute[75203]:     </video>
Nov 28 18:35:21 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:35:21 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:35:21 user nova-compute[75203]:     </rng>
Nov 28 18:35:21 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:35:21 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:35:21 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:35:21 user nova-compute[75203]:     </memballoon>
Nov 28 18:35:21 user nova-compute[75203]:   </devices>
Nov 28 18:35:21 user nova-compute[75203]: </domain>
Nov 28 18:35:21 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1275372563',display_name='tempest-VolumesAssistedSnapshotsTest-server-1275372563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1275372563',id=8,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSDKDOyoA50IykOcPcwZMwj1/NCArQSKD9IkTZ49ITJnbiR5BozHbuRb+Vgckj0Qx43iqZGM5cr45WSxOs/m46CDMSjAJHRznXRz7tERn1H167CHLjovYdUsLB67SsRvw==',key_name='tempest-keypair-596320098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d291690301244eb495c371c6b5ccc3fd',ramdisk_id='',reservation_id='r-4yrad7cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1665206057',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1665206057-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3684f12fd03a4eeb95b13e13cd21f7a2',uuid=a233bb09-8c6e-44d0-945f-ee219a6e1bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Converting VIF {"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0c81299-ac22-4675-a91b-3e8ce5d9c9ef,network=Network(bfe34745-c11f-46e3-8006-cc78186840fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c81299-ac') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG os_vif [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0c81299-ac22-4675-a91b-3e8ce5d9c9ef,network=Network(bfe34745-c11f-46e3-8006-cc78186840fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c81299-ac') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c59b677-e3c8-5929-958c-fa19f192865b', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0c81299-ac, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0c81299-ac, col_values=(('qos', UUID('bee85c6d-83ea-4759-a478-8bc2a46bc114')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0c81299-ac, col_values=(('external_ids', {'iface-id': 'e0c81299-ac22-4675-a91b-3e8ce5d9c9ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:68:9d', 'vm-uuid': 'a233bb09-8c6e-44d0-945f-ee219a6e1bfa'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:21 user nova-compute[75203]: INFO os_vif [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0c81299-ac22-4675-a91b-3e8ce5d9c9ef,network=Network(bfe34745-c11f-46e3-8006-cc78186840fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c81299-ac')
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:35:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] No VIF found with MAC fa:16:3e:8d:68:9d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:35:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Updated VIF entry in instance network info cache for port e0c81299-ac22-4675-a91b-3e8ce5d9c9ef. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:35:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Updating instance_info_cache with network_info: [{"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1ee12672-35df-44ae-9c83-6b3de39ffc96 req-df0a1b2a-b5fd-43e0-a2bf-947c602eee54 service nova] Releasing lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-f81c9d90-90a4-43eb-997d-2ebeb0be0719 req-dffb27b8-4d3d-4439-b757-af22169b037c service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f81c9d90-90a4-43eb-997d-2ebeb0be0719 req-dffb27b8-4d3d-4439-b757-af22169b037c service nova] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f81c9d90-90a4-43eb-997d-2ebeb0be0719 req-dffb27b8-4d3d-4439-b757-af22169b037c service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f81c9d90-90a4-43eb-997d-2ebeb0be0719 req-dffb27b8-4d3d-4439-b757-af22169b037c service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-f81c9d90-90a4-43eb-997d-2ebeb0be0719 req-dffb27b8-4d3d-4439-b757-af22169b037c service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] No waiting events found dispatching network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:23 user nova-compute[75203]: WARNING nova.compute.manager [req-f81c9d90-90a4-43eb-997d-2ebeb0be0719 req-dffb27b8-4d3d-4439-b757-af22169b037c service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received unexpected event network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef for instance with vm_state building and task_state spawning.
Nov 28 18:35:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:35:24 user nova-compute[75203]: INFO nova.compute.claims [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Claim successful on node user
Nov 28 18:35:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.network.neutron [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:35:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:35:24 user nova-compute[75203]: DEBUG nova.policy [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc933353e4e643ea86c6dfb0337302b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93335bb18c124da8b9eb12111d71ff4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:35:25 user nova-compute[75203]: INFO nova.virt.block_device [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Booting with volume ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 at /dev/vda
Nov 28 18:35:25 user nova-compute[75203]: DEBUG os_brick.utils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:35:25 user nova-compute[75203]: INFO oslo.privsep.daemon [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0dpbacmh/privsep.sock']
Nov 28 18:35:25 user sudo[85944]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0dpbacmh/privsep.sock
Nov 28 18:35:25 user sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-84e1591d-3928-43c4-94d1-e9980f309d3b req-be6c1b4f-1b18-4010-a6f4-5899d634758a service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-84e1591d-3928-43c4-94d1-e9980f309d3b req-be6c1b4f-1b18-4010-a6f4-5899d634758a service nova] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-84e1591d-3928-43c4-94d1-e9980f309d3b req-be6c1b4f-1b18-4010-a6f4-5899d634758a service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-84e1591d-3928-43c4-94d1-e9980f309d3b req-be6c1b4f-1b18-4010-a6f4-5899d634758a service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-84e1591d-3928-43c4-94d1-e9980f309d3b req-be6c1b4f-1b18-4010-a6f4-5899d634758a service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] No waiting events found dispatching network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:26 user nova-compute[75203]: WARNING nova.compute.manager [req-84e1591d-3928-43c4-94d1-e9980f309d3b req-be6c1b4f-1b18-4010-a6f4-5899d634758a service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received unexpected event network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef for instance with vm_state building and task_state spawning.
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.network.neutron [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Successfully created port: 547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:26 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Instance spawned successfully.
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:26 user nova-compute[75203]: INFO nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Took 8.95 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0239b06-2cec-443a-9568-e6b896a998ec req-51d2dee2-22b5-4f3a-80ff-b160200ed741 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0239b06-2cec-443a-9568-e6b896a998ec req-51d2dee2-22b5-4f3a-80ff-b160200ed741 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0239b06-2cec-443a-9568-e6b896a998ec req-51d2dee2-22b5-4f3a-80ff-b160200ed741 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0239b06-2cec-443a-9568-e6b896a998ec req-51d2dee2-22b5-4f3a-80ff-b160200ed741 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0239b06-2cec-443a-9568-e6b896a998ec req-51d2dee2-22b5-4f3a-80ff-b160200ed741 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:26 user nova-compute[75203]: WARNING nova.compute.manager [req-f0239b06-2cec-443a-9568-e6b896a998ec req-51d2dee2-22b5-4f3a-80ff-b160200ed741 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state active and task_state None.
Nov 28 18:35:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:26 user nova-compute[75203]: INFO nova.compute.manager [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Took 10.29 seconds to build instance.
Nov 28 18:35:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb7cfb44-604d-4e86-9758-407e8d726b9c tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.524s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Successfully updated port: 547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:27 user sudo[85944]: pam_unix(sudo:session): session closed for user root
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquired lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:35:27 user nova-compute[75203]: INFO oslo.privsep.daemon [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Spawned new privsep daemon via rootwrap
Nov 28 18:35:27 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 28 18:35:27 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 28 18:35:27 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 28 18:35:27 user nova-compute[75203]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85951
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c8a28-23bf-4e21-bb08-1b2b127b2f50]: (2,) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd2636-71a6-4ef2-9762-341d296a1602]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:27 user nova-compute[75203]: WARNING os_brick.initiator.connectors.nvmeof [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa91d4a8-72f9-4695-ade0-6a42fda9b457]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cd13a7-278b-4fb0-82ce-01f57c86b583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba230a06-6038-4337-92d4-c5f72bbc7243]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:35:27 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[befe9991-1450-487c-99a4-28dd8990cb35]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG os_brick.utils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] <== get_connector_properties: return (2526ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updating existing volume attachment record: ae7e3341-7bb0-4c37-aeb9-fddb56055d5e {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updating instance_info_cache with network_info: [{"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Releasing lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:27 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance network_info: |[{"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-changed-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Refreshing instance network info cache due to event network-changed-547b5c17-1da6-4e8e-92fa-4edd0aabcdad. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] Acquiring lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] Acquired lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG nova.network.neutron [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Refreshing network info cache for port 547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-4eb32528-118a-4c3e-beb4-d53f555d4e44 req-20f0772d-8e86-44cc-866b-540fc79a62f1 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4eb32528-118a-4c3e-beb4-d53f555d4e44 req-20f0772d-8e86-44cc-866b-540fc79a62f1 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4eb32528-118a-4c3e-beb4-d53f555d4e44 req-20f0772d-8e86-44cc-866b-540fc79a62f1 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4eb32528-118a-4c3e-beb4-d53f555d4e44 req-20f0772d-8e86-44cc-866b-540fc79a62f1 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-4eb32528-118a-4c3e-beb4-d53f555d4e44 req-20f0772d-8e86-44cc-866b-540fc79a62f1 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:28 user nova-compute[75203]: WARNING nova.compute.manager [req-4eb32528-118a-4c3e-beb4-d53f555d4e44 req-20f0772d-8e86-44cc-866b-540fc79a62f1 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state active and task_state None.
Nov 28 18:35:29 user nova-compute[75203]: DEBUG nova.network.neutron [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updated VIF entry in instance network info cache for port 547b5c17-1da6-4e8e-92fa-4edd0aabcdad. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:35:29 user nova-compute[75203]: DEBUG nova.network.neutron [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updating instance_info_cache with network_info: [{"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bf90ec2e-7de1-436a-b3a6-f7a6519bcd1b req-3f768f04-4cd6-45f0-829e-38423262c82d service nova] Releasing lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 18:35:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:35:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-03836342-0e86-489a-baec-7ea4de9c1c55 req-ca2d5729-53b7-40e6-a395-7b36bf10db8e service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03836342-0e86-489a-baec-7ea4de9c1c55 req-ca2d5729-53b7-40e6-a395-7b36bf10db8e service nova] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03836342-0e86-489a-baec-7ea4de9c1c55 req-ca2d5729-53b7-40e6-a395-7b36bf10db8e service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03836342-0e86-489a-baec-7ea4de9c1c55 req-ca2d5729-53b7-40e6-a395-7b36bf10db8e service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-03836342-0e86-489a-baec-7ea4de9c1c55 req-ca2d5729-53b7-40e6-a395-7b36bf10db8e service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] No waiting events found dispatching network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:33 user nova-compute[75203]: WARNING nova.compute.manager [req-03836342-0e86-489a-baec-7ea4de9c1c55 req-ca2d5729-53b7-40e6-a395-7b36bf10db8e service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received unexpected event network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 for instance with vm_state active and task_state None.
Nov 28 18:35:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-cb860e4c-7669-4c3a-b1b1-8884b7939b2d req-e5ae3ace-2ac6-4667-af5d-dad025da4304 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cb860e4c-7669-4c3a-b1b1-8884b7939b2d req-e5ae3ace-2ac6-4667-af5d-dad025da4304 service nova] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cb860e4c-7669-4c3a-b1b1-8884b7939b2d req-e5ae3ace-2ac6-4667-af5d-dad025da4304 service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cb860e4c-7669-4c3a-b1b1-8884b7939b2d req-e5ae3ace-2ac6-4667-af5d-dad025da4304 service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-cb860e4c-7669-4c3a-b1b1-8884b7939b2d req-e5ae3ace-2ac6-4667-af5d-dad025da4304 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] No waiting events found dispatching network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:35 user nova-compute[75203]: WARNING nova.compute.manager [req-cb860e4c-7669-4c3a-b1b1-8884b7939b2d req-e5ae3ace-2ac6-4667-af5d-dad025da4304 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received unexpected event network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 for instance with vm_state active and task_state None.
Nov 28 18:35:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:36 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:35:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Creating image(s)
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Ensure instance console log exists: /opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Start _get_guest_xml network_info=[{"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8e8fdb2-f3a6-45dc-96d2-b9703922ef10', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'serial': 'ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'ae7e3341-7bb0-4c37-aeb9-fddb56055d5e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:35:37 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:37 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connector [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Factory for ISCSI on None {{(pid=75203) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:35:37 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:35:37 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:35:37 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1f456b-2925-4cc8-82b2-98db07f5a8c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:35:37 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f5dec6-1403-4b05-9992-d1a9eb051c93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8] added
Nov 28 18:35:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8afb5-adb4-439b-887a-791675e6edc1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f907f8e6-6997-434e-9577-843e57da9570]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbWXnoiw {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbWXnoiw" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[62231c46-4550-44bc-83e4-dac7e1f7462a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tbWXnoiw'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[336634b0-61e8-44a7-92e6-3aaa665029ea]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[88168bc4-d2de-4abe-a875-96cb6a77800e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 18:35:37 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:35:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 18:35:37 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:35:37 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 18:35:37 user nova-compute[75203]: 
Nov 28 18:35:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c916210c-3b09-4bb7-8ffd-6f483afbcbcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]
Nov 28 18:35:38 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.
Nov 28 18:35:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae69fbd-2e56-44c5-81a6-74aa7f7de0ec]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e3b75-2880-4738-af22-da2b4e01a8e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:35:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:35:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[495f47f2-e0ea-4bba-ac04-84962b048800]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23637373137303033', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373137303033', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1540435995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540435995',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6oL/7vvy9taX59bYI1WkM2HscWCZsFVsysC1exh/0Cmaz5gesQgSdKJwRW00bX89IFpRG0IkpITdH7sGiUa2XGjjHsEJIxVsYERrNHqSdOkmfTf8b+AU/z+Ywzde3ffQ==',key_name='tempest-keypair-1295110036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93335bb18c124da8b9eb12111d71ff4f',ramdisk_id='',reservation_id='r-1occtchr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-647964474',owner_user_name='tempest-ServerActionsV293TestJSON-647964474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc933353e4e643ea86c6dfb0337302b1',uuid=b8e8fdb2-f3a6-45dc-96d2-b9703922ef10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converting VIF {"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.objects.instance [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:35:39 user nova-compute[75203]:   <uuid>b8e8fdb2-f3a6-45dc-96d2-b9703922ef10</uuid>
Nov 28 18:35:39 user nova-compute[75203]:   <name>instance-00000009</name>
Nov 28 18:35:39 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:35:39 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:35:39 user nova-compute[75203]:   <metadata>
Nov 28 18:35:39 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:35:39 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:35:39 user nova-compute[75203]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1540435995</nova:name>
Nov 28 18:35:39 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:35:37</nova:creationTime>
Nov 28 18:35:39 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:35:39 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:35:39 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:35:39 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:35:39 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:35:39 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:35:39 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:35:39 user nova-compute[75203]:       <nova:owner>
Nov 28 18:35:39 user nova-compute[75203]:         <nova:user uuid="fc933353e4e643ea86c6dfb0337302b1">tempest-ServerActionsV293TestJSON-647964474-project-member</nova:user>
Nov 28 18:35:39 user nova-compute[75203]:         <nova:project uuid="93335bb18c124da8b9eb12111d71ff4f">tempest-ServerActionsV293TestJSON-647964474</nova:project>
Nov 28 18:35:39 user nova-compute[75203]:       </nova:owner>
Nov 28 18:35:39 user nova-compute[75203]:       <nova:ports>
Nov 28 18:35:39 user nova-compute[75203]:         <nova:port uuid="547b5c17-1da6-4e8e-92fa-4edd0aabcdad">
Nov 28 18:35:39 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:35:39 user nova-compute[75203]:         </nova:port>
Nov 28 18:35:39 user nova-compute[75203]:       </nova:ports>
Nov 28 18:35:39 user nova-compute[75203]:     </nova:instance>
Nov 28 18:35:39 user nova-compute[75203]:   </metadata>
Nov 28 18:35:39 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:35:39 user nova-compute[75203]:     <system>
Nov 28 18:35:39 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:35:39 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:35:39 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:35:39 user nova-compute[75203]:       <entry name="serial">b8e8fdb2-f3a6-45dc-96d2-b9703922ef10</entry>
Nov 28 18:35:39 user nova-compute[75203]:       <entry name="uuid">b8e8fdb2-f3a6-45dc-96d2-b9703922ef10</entry>
Nov 28 18:35:39 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:35:39 user nova-compute[75203]:     </system>
Nov 28 18:35:39 user nova-compute[75203]:   </sysinfo>
Nov 28 18:35:39 user nova-compute[75203]:   <os>
Nov 28 18:35:39 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:35:39 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:35:39 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:35:39 user nova-compute[75203]:   </os>
Nov 28 18:35:39 user nova-compute[75203]:   <features>
Nov 28 18:35:39 user nova-compute[75203]:     <acpi/>
Nov 28 18:35:39 user nova-compute[75203]:     <apic/>
Nov 28 18:35:39 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:35:39 user nova-compute[75203]:   </features>
Nov 28 18:35:39 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:35:39 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:35:39 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:35:39 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:35:39 user nova-compute[75203]:   </clock>
Nov 28 18:35:39 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:35:39 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:35:39 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:35:39 user nova-compute[75203]:   </cpu>
Nov 28 18:35:39 user nova-compute[75203]:   <devices>
Nov 28 18:35:39 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:35:39 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:35:39 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 18:35:39 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:35:39 user nova-compute[75203]:       <serial>ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8</serial>
Nov 28 18:35:39 user nova-compute[75203]:     </disk>
Nov 28 18:35:39 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:35:39 user nova-compute[75203]:       <mac address="fa:16:3e:73:e0:37"/>
Nov 28 18:35:39 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:39 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:35:39 user nova-compute[75203]:       <target dev="tap547b5c17-1d"/>
Nov 28 18:35:39 user nova-compute[75203]:     </interface>
Nov 28 18:35:39 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:35:39 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10/console.log" append="off"/>
Nov 28 18:35:39 user nova-compute[75203]:     </serial>
Nov 28 18:35:39 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:35:39 user nova-compute[75203]:     <video>
Nov 28 18:35:39 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:39 user nova-compute[75203]:     </video>
Nov 28 18:35:39 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:35:39 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:35:39 user nova-compute[75203]:     </rng>
Nov 28 18:35:39 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:35:39 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:35:39 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:35:39 user nova-compute[75203]:     </memballoon>
Nov 28 18:35:39 user nova-compute[75203]:   </devices>
Nov 28 18:35:39 user nova-compute[75203]: </domain>
Nov 28 18:35:39 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1540435995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540435995',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6oL/7vvy9taX59bYI1WkM2HscWCZsFVsysC1exh/0Cmaz5gesQgSdKJwRW00bX89IFpRG0IkpITdH7sGiUa2XGjjHsEJIxVsYERrNHqSdOkmfTf8b+AU/z+Ywzde3ffQ==',key_name='tempest-keypair-1295110036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93335bb18c124da8b9eb12111d71ff4f',ramdisk_id='',reservation_id='r-1occtchr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-647964474',owner_user_name='tempest-ServerActionsV293TestJSON-647964474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc933353e4e643ea86c6dfb0337302b1',uuid=b8e8fdb2-f3a6-45dc-96d2-b9703922ef10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converting VIF {"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG os_vif [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31e9206c-660a-518c-b0db-269fe32067fb', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap547b5c17-1d, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap547b5c17-1d, col_values=(('qos', UUID('10659487-f20d-4bb7-87c7-e4051d73dae1')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap547b5c17-1d, col_values=(('external_ids', {'iface-id': '547b5c17-1da6-4e8e-92fa-4edd0aabcdad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:e0:37', 'vm-uuid': 'b8e8fdb2-f3a6-45dc-96d2-b9703922ef10'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:39 user nova-compute[75203]: INFO os_vif [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d')
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] No VIF found with MAC fa:16:3e:73:e0:37, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-97437f9d-cb92-4813-ae2a-cd53a0f9cae1 req-267e6c93-94e3-4b60-866b-e606f56a3e8f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97437f9d-cb92-4813-ae2a-cd53a0f9cae1 req-267e6c93-94e3-4b60-866b-e606f56a3e8f service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97437f9d-cb92-4813-ae2a-cd53a0f9cae1 req-267e6c93-94e3-4b60-866b-e606f56a3e8f service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97437f9d-cb92-4813-ae2a-cd53a0f9cae1 req-267e6c93-94e3-4b60-866b-e606f56a3e8f service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-97437f9d-cb92-4813-ae2a-cd53a0f9cae1 req-267e6c93-94e3-4b60-866b-e606f56a3e8f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:43 user nova-compute[75203]: WARNING nova.compute.manager [req-97437f9d-cb92-4813-ae2a-cd53a0f9cae1 req-267e6c93-94e3-4b60-866b-e606f56a3e8f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received unexpected event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with vm_state building and task_state spawning.
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-77c5ac93-28f1-4997-8645-89b0c6ac73b1 req-633bd8e1-833a-4f6e-8f48-a700b427145b service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77c5ac93-28f1-4997-8645-89b0c6ac73b1 req-633bd8e1-833a-4f6e-8f48-a700b427145b service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77c5ac93-28f1-4997-8645-89b0c6ac73b1 req-633bd8e1-833a-4f6e-8f48-a700b427145b service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77c5ac93-28f1-4997-8645-89b0c6ac73b1 req-633bd8e1-833a-4f6e-8f48-a700b427145b service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-77c5ac93-28f1-4997-8645-89b0c6ac73b1 req-633bd8e1-833a-4f6e-8f48-a700b427145b service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:43 user nova-compute[75203]: WARNING nova.compute.manager [req-77c5ac93-28f1-4997-8645-89b0c6ac73b1 req-633bd8e1-833a-4f6e-8f48-a700b427145b service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received unexpected event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with vm_state building and task_state spawning.
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "6663b95e-c45f-4ffc-abba-ca678dbd898e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:43 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:43 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7461MB free_disk=25.497089385986328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance spawned successfully.
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:43 user nova-compute[75203]: INFO nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:43 user nova-compute[75203]: INFO nova.compute.manager [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Took 19.89 seconds to build instance.
Nov 28 18:35:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c59ac6e1-3b11-4158-8e75-ed941c3d97f5 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.143s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b48f122d-af9c-400c-8a7a-0c1303cc0cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 72f841aa-13fb-4373-9225-2df8a700e045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 6663b95e-c45f-4ffc-abba-ca678dbd898e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.029s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.694s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:35:44 user nova-compute[75203]: INFO nova.compute.claims [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Claim successful on node user
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:35:45 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:35:45 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Creating image(s)
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "/opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "/opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "/opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.policy [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '678261cef73e4dcabd85b927b45aeb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d831ddd234468f876de2b487471f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Skipping network cache update for instance because it is Building. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.216s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid b48f122d-af9c-400c-8a7a-0c1303cc0cb8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk 1073741824" returned: 0 in 0.077s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Cannot resize image /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Ensure instance console log exists: /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updating instance_info_cache with network_info: [{"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Successfully created port: a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-b48f122d-af9c-400c-8a7a-0c1303cc0cb8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:35:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Successfully updated port: a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "refresh_cache-6663b95e-c45f-4ffc-abba-ca678dbd898e" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquired lock "refresh_cache-6663b95e-c45f-4ffc-abba-ca678dbd898e" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received event network-changed-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Refreshing instance network info cache due to event network-changed-a743ed4c-f580-4b0d-99ee-0700df5d5d92. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] Acquiring lock "refresh_cache-6663b95e-c45f-4ffc-abba-ca678dbd898e" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Updating instance_info_cache with network_info: [{"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Releasing lock "refresh_cache-6663b95e-c45f-4ffc-abba-ca678dbd898e" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Instance network_info: |[{"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] Acquired lock "refresh_cache-6663b95e-c45f-4ffc-abba-ca678dbd898e" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.neutron [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Refreshing network info cache for port a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Start _get_guest_xml network_info=[{"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:35:48 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:48 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1723863283',display_name='tempest-VolumesActionsTest-instance-1723863283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1723863283',id=10,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94d831ddd234468f876de2b487471f02',ramdisk_id='',reservation_id='r-l0j8q4em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-15073388',owner_user_name='tempest-VolumesActionsTest-15073388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:45Z,user_data=None,user_id='678261cef73e4dcabd85b927b45aeb97',uuid=6663b95e-c45f-4ffc-abba-ca678dbd898e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Converting VIF {"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:1b,bridge_name='br-int',has_traffic_filtering=True,id=a743ed4c-f580-4b0d-99ee-0700df5d5d92,network=Network(416b7082-90b8-4b86-bbbd-4668b284f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa743ed4c-f5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.objects.instance [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lazy-loading 'pci_devices' on Instance uuid 6663b95e-c45f-4ffc-abba-ca678dbd898e {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:35:48 user nova-compute[75203]:   <uuid>6663b95e-c45f-4ffc-abba-ca678dbd898e</uuid>
Nov 28 18:35:48 user nova-compute[75203]:   <name>instance-0000000a</name>
Nov 28 18:35:48 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:35:48 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:35:48 user nova-compute[75203]:   <metadata>
Nov 28 18:35:48 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:35:48 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:35:48 user nova-compute[75203]:       <nova:name>tempest-VolumesActionsTest-instance-1723863283</nova:name>
Nov 28 18:35:48 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:35:48</nova:creationTime>
Nov 28 18:35:48 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:35:48 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:35:48 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:35:48 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:35:48 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:35:48 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:35:48 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:35:48 user nova-compute[75203]:       <nova:owner>
Nov 28 18:35:48 user nova-compute[75203]:         <nova:user uuid="678261cef73e4dcabd85b927b45aeb97">tempest-VolumesActionsTest-15073388-project-member</nova:user>
Nov 28 18:35:48 user nova-compute[75203]:         <nova:project uuid="94d831ddd234468f876de2b487471f02">tempest-VolumesActionsTest-15073388</nova:project>
Nov 28 18:35:48 user nova-compute[75203]:       </nova:owner>
Nov 28 18:35:48 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:35:48 user nova-compute[75203]:       <nova:ports>
Nov 28 18:35:48 user nova-compute[75203]:         <nova:port uuid="a743ed4c-f580-4b0d-99ee-0700df5d5d92">
Nov 28 18:35:48 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 18:35:48 user nova-compute[75203]:         </nova:port>
Nov 28 18:35:48 user nova-compute[75203]:       </nova:ports>
Nov 28 18:35:48 user nova-compute[75203]:     </nova:instance>
Nov 28 18:35:48 user nova-compute[75203]:   </metadata>
Nov 28 18:35:48 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:35:48 user nova-compute[75203]:     <system>
Nov 28 18:35:48 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:35:48 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:35:48 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:35:48 user nova-compute[75203]:       <entry name="serial">6663b95e-c45f-4ffc-abba-ca678dbd898e</entry>
Nov 28 18:35:48 user nova-compute[75203]:       <entry name="uuid">6663b95e-c45f-4ffc-abba-ca678dbd898e</entry>
Nov 28 18:35:48 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:35:48 user nova-compute[75203]:     </system>
Nov 28 18:35:48 user nova-compute[75203]:   </sysinfo>
Nov 28 18:35:48 user nova-compute[75203]:   <os>
Nov 28 18:35:48 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:35:48 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:35:48 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:35:48 user nova-compute[75203]:   </os>
Nov 28 18:35:48 user nova-compute[75203]:   <features>
Nov 28 18:35:48 user nova-compute[75203]:     <acpi/>
Nov 28 18:35:48 user nova-compute[75203]:     <apic/>
Nov 28 18:35:48 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:35:48 user nova-compute[75203]:   </features>
Nov 28 18:35:48 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:35:48 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:35:48 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:35:48 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:35:48 user nova-compute[75203]:   </clock>
Nov 28 18:35:48 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:35:48 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:35:48 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:35:48 user nova-compute[75203]:   </cpu>
Nov 28 18:35:48 user nova-compute[75203]:   <devices>
Nov 28 18:35:48 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:35:48 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:35:48 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk"/>
Nov 28 18:35:48 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:35:48 user nova-compute[75203]:     </disk>
Nov 28 18:35:48 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:35:48 user nova-compute[75203]:       <mac address="fa:16:3e:9e:34:1b"/>
Nov 28 18:35:48 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:48 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:35:48 user nova-compute[75203]:       <target dev="tapa743ed4c-f5"/>
Nov 28 18:35:48 user nova-compute[75203]:     </interface>
Nov 28 18:35:48 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:35:48 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/console.log" append="off"/>
Nov 28 18:35:48 user nova-compute[75203]:     </serial>
Nov 28 18:35:48 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:35:48 user nova-compute[75203]:     <video>
Nov 28 18:35:48 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:48 user nova-compute[75203]:     </video>
Nov 28 18:35:48 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:35:48 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:35:48 user nova-compute[75203]:     </rng>
Nov 28 18:35:48 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:35:48 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:35:48 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:35:48 user nova-compute[75203]:     </memballoon>
Nov 28 18:35:48 user nova-compute[75203]:   </devices>
Nov 28 18:35:48 user nova-compute[75203]: </domain>
Nov 28 18:35:48 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1723863283',display_name='tempest-VolumesActionsTest-instance-1723863283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1723863283',id=10,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94d831ddd234468f876de2b487471f02',ramdisk_id='',reservation_id='r-l0j8q4em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-15073388',owner_user_name='tempest-VolumesActionsTest-15073388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:45Z,user_data=None,user_id='678261cef73e4dcabd85b927b45aeb97',uuid=6663b95e-c45f-4ffc-abba-ca678dbd898e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Converting VIF {"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:1b,bridge_name='br-int',has_traffic_filtering=True,id=a743ed4c-f580-4b0d-99ee-0700df5d5d92,network=Network(416b7082-90b8-4b86-bbbd-4668b284f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa743ed4c-f5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG os_vif [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:1b,bridge_name='br-int',has_traffic_filtering=True,id=a743ed4c-f580-4b0d-99ee-0700df5d5d92,network=Network(416b7082-90b8-4b86-bbbd-4668b284f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa743ed4c-f5') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '112dba27-095e-5156-934e-baa1f47b27ce', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa743ed4c-f5, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa743ed4c-f5, col_values=(('qos', UUID('d1f978a1-21d3-4379-9b07-5a827e545da2')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa743ed4c-f5, col_values=(('external_ids', {'iface-id': 'a743ed4c-f580-4b0d-99ee-0700df5d5d92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:34:1b', 'vm-uuid': '6663b95e-c45f-4ffc-abba-ca678dbd898e'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:48 user nova-compute[75203]: INFO os_vif [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:1b,bridge_name='br-int',has_traffic_filtering=True,id=a743ed4c-f580-4b0d-99ee-0700df5d5d92,network=Network(416b7082-90b8-4b86-bbbd-4668b284f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa743ed4c-f5')
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] No VIF found with MAC fa:16:3e:9e:34:1b, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.neutron [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Updated VIF entry in instance network info cache for port a743ed4c-f580-4b0d-99ee-0700df5d5d92. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG nova.network.neutron [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Updating instance_info_cache with network_info: [{"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-513d122a-cc73-48fd-b59b-12edaabf14e4 req-c7e45d59-436a-4fd7-adb0-a66161939d3f service nova] Releasing lock "refresh_cache-6663b95e-c45f-4ffc-abba-ca678dbd898e" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "16c72606-ed4c-4c7a-8295-a76da36da957" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:35:49 user nova-compute[75203]: INFO nova.compute.claims [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Claim successful on node user
Nov 28 18:35:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:49 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:35:50 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:35:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:50 user nova-compute[75203]: INFO nova.virt.block_device [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Booting with volume dbd80f90-116f-44ba-913b-955f4d331daf at /dev/vda
Nov 28 18:35:50 user nova-compute[75203]: DEBUG os_brick.utils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.policy [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0855ea71a4084541936c00003279c26d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730532d801394235950dc0a30cf94733', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c31279-c3b8-457c-9a0b-bb0c864f653d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[81410ad8-3cf9-4098-981e-cfe6def921cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfebf9a-0e8f-4bb8-b45b-bce196bda4f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f6c249-604a-423d-86f1-e6010f957f29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:35:50 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3239ab-6fbb-416d-bcd9-e59d970c5561]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG os_brick.utils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating existing volume attachment record: a8788633-c0ef-456b-b8f8-1875f13f49b6 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-5ac1a08e-bf0c-41f2-b099-9974b5bad28d req-c35d7cd3-8cf9-4e0e-9716-0d1592785b2c service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received event network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5ac1a08e-bf0c-41f2-b099-9974b5bad28d req-c35d7cd3-8cf9-4e0e-9716-0d1592785b2c service nova] Acquiring lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5ac1a08e-bf0c-41f2-b099-9974b5bad28d req-c35d7cd3-8cf9-4e0e-9716-0d1592785b2c service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5ac1a08e-bf0c-41f2-b099-9974b5bad28d req-c35d7cd3-8cf9-4e0e-9716-0d1592785b2c service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-5ac1a08e-bf0c-41f2-b099-9974b5bad28d req-c35d7cd3-8cf9-4e0e-9716-0d1592785b2c service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] No waiting events found dispatching network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:50 user nova-compute[75203]: WARNING nova.compute.manager [req-5ac1a08e-bf0c-41f2-b099-9974b5bad28d req-c35d7cd3-8cf9-4e0e-9716-0d1592785b2c service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received unexpected event network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 for instance with vm_state building and task_state spawning.
Nov 28 18:35:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully created port: 9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully created port: 5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-83e41c0e-64aa-4348-a0ea-1d9434ef2546 req-b6d53c49-7b0f-4ddd-b4ea-02023dbc259f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received event network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-83e41c0e-64aa-4348-a0ea-1d9434ef2546 req-b6d53c49-7b0f-4ddd-b4ea-02023dbc259f service nova] Acquiring lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-83e41c0e-64aa-4348-a0ea-1d9434ef2546 req-b6d53c49-7b0f-4ddd-b4ea-02023dbc259f service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-83e41c0e-64aa-4348-a0ea-1d9434ef2546 req-b6d53c49-7b0f-4ddd-b4ea-02023dbc259f service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-83e41c0e-64aa-4348-a0ea-1d9434ef2546 req-b6d53c49-7b0f-4ddd-b4ea-02023dbc259f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] No waiting events found dispatching network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:35:52 user nova-compute[75203]: WARNING nova.compute.manager [req-83e41c0e-64aa-4348-a0ea-1d9434ef2546 req-b6d53c49-7b0f-4ddd-b4ea-02023dbc259f service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received unexpected event network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 for instance with vm_state building and task_state spawning.
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:35:52 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Instance spawned successfully.
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully created port: 194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:35:53 user nova-compute[75203]: INFO nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Took 7.52 seconds to spawn the instance on the hypervisor.
Nov 28 18:35:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:35:53 user nova-compute[75203]: INFO nova.compute.manager [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Took 9.39 seconds to build instance.
Nov 28 18:35:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-60fa29c0-60f5-4019-81da-307961afdd60 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.535s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully created port: 7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully created port: 8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully updated port: 9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-9d8bae68-1062-4edb-b1b3-27ff8b55b225. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG nova.network.neutron [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port 9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG nova.network.neutron [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:35:55 user nova-compute[75203]: INFO nova.compute.claims [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Claim successful on node user
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.network.neutron [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8c2efdb5-529a-43b6-b192-0449e7eb7a68 req-e6d86e37-2308-4d7d-a7b3-7eb001000467 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully updated port: d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:35:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.policy [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7651a46356c14d6690c6422cc778187b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d89c2f27be453c810b8ea57efbc921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:35:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Creating image(s)
Nov 28 18:35:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "/opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "/opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "/opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.220s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.229s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk 1073741824" returned: 0 in 0.060s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-d28852c4-aebd-4cc2-af45-f02e6b6226b7. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.network.neutron [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.258s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.network.neutron [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Cannot resize image /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Ensure instance console log exists: /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully updated port: 986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:57 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Successfully created port: 80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:35:58 user nova-compute[75203]: DEBUG nova.network.neutron [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-aca4599a-0f7c-49ec-9791-9212dac96f6a req-c59abcc3-2cb6-41fd-aa3a-acb876c3ead6 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:58 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully updated port: 5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Successfully updated port: 80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquired lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-986fa26d-73d2-4879-9213-2adb023290d8. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port 986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updating instance_info_cache with network_info: [{"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Releasing lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Instance network_info: |[{"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Start _get_guest_xml network_info=[{"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:35:59 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:59 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2141242460',display_name='tempest-TestServerVolumeAttachmentScenario-server-2141242460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2141242460',id=12,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXiig/ft+B2jr5SVTsnP+QQEXnzqbcBQPl55+4MzFT+j4CvH5nduKO2t460YjFPRzfUMgPZJYmuJmWWeWcJIkcFSlMadPe6TD7poay7gIAyQ6XFyXpzIiOzKhBEgG6Nug==',key_name='tempest-keypair-47000978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3d89c2f27be453c810b8ea57efbc921',ramdisk_id='',reservation_id='r-mukwt9f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1676841860',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1676841860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7651a46356c14d6690c6422cc778187b',uuid=eec19476-5b8e-4d91-b0e3-6ecd0986632d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Converting VIF {"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:98:94,bridge_name='br-int',has_traffic_filtering=True,id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb,network=Network(2863569b-7646-4eaa-88d4-eede654c5597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e627df-b7') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lazy-loading 'pci_devices' on Instance uuid eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:35:59 user nova-compute[75203]:   <uuid>eec19476-5b8e-4d91-b0e3-6ecd0986632d</uuid>
Nov 28 18:35:59 user nova-compute[75203]:   <name>instance-0000000c</name>
Nov 28 18:35:59 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:35:59 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:35:59 user nova-compute[75203]:   <metadata>
Nov 28 18:35:59 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:35:59 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:35:59 user nova-compute[75203]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2141242460</nova:name>
Nov 28 18:35:59 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:35:59</nova:creationTime>
Nov 28 18:35:59 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:35:59 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:35:59 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:35:59 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:35:59 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:35:59 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:35:59 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:35:59 user nova-compute[75203]:       <nova:owner>
Nov 28 18:35:59 user nova-compute[75203]:         <nova:user uuid="7651a46356c14d6690c6422cc778187b">tempest-TestServerVolumeAttachmentScenario-1676841860-project-member</nova:user>
Nov 28 18:35:59 user nova-compute[75203]:         <nova:project uuid="a3d89c2f27be453c810b8ea57efbc921">tempest-TestServerVolumeAttachmentScenario-1676841860</nova:project>
Nov 28 18:35:59 user nova-compute[75203]:       </nova:owner>
Nov 28 18:35:59 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:35:59 user nova-compute[75203]:       <nova:ports>
Nov 28 18:35:59 user nova-compute[75203]:         <nova:port uuid="80e627df-b79d-48cd-8445-3ca7c1cc7eeb">
Nov 28 18:35:59 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 18:35:59 user nova-compute[75203]:         </nova:port>
Nov 28 18:35:59 user nova-compute[75203]:       </nova:ports>
Nov 28 18:35:59 user nova-compute[75203]:     </nova:instance>
Nov 28 18:35:59 user nova-compute[75203]:   </metadata>
Nov 28 18:35:59 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:35:59 user nova-compute[75203]:     <system>
Nov 28 18:35:59 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:35:59 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:35:59 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:35:59 user nova-compute[75203]:       <entry name="serial">eec19476-5b8e-4d91-b0e3-6ecd0986632d</entry>
Nov 28 18:35:59 user nova-compute[75203]:       <entry name="uuid">eec19476-5b8e-4d91-b0e3-6ecd0986632d</entry>
Nov 28 18:35:59 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:35:59 user nova-compute[75203]:     </system>
Nov 28 18:35:59 user nova-compute[75203]:   </sysinfo>
Nov 28 18:35:59 user nova-compute[75203]:   <os>
Nov 28 18:35:59 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:35:59 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:35:59 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:35:59 user nova-compute[75203]:   </os>
Nov 28 18:35:59 user nova-compute[75203]:   <features>
Nov 28 18:35:59 user nova-compute[75203]:     <acpi/>
Nov 28 18:35:59 user nova-compute[75203]:     <apic/>
Nov 28 18:35:59 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:35:59 user nova-compute[75203]:   </features>
Nov 28 18:35:59 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:35:59 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:35:59 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:35:59 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:35:59 user nova-compute[75203]:   </clock>
Nov 28 18:35:59 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:35:59 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:35:59 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:35:59 user nova-compute[75203]:   </cpu>
Nov 28 18:35:59 user nova-compute[75203]:   <devices>
Nov 28 18:35:59 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:35:59 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:35:59 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk"/>
Nov 28 18:35:59 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:35:59 user nova-compute[75203]:     </disk>
Nov 28 18:35:59 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:35:59 user nova-compute[75203]:       <mac address="fa:16:3e:91:98:94"/>
Nov 28 18:35:59 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:59 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:35:59 user nova-compute[75203]:       <target dev="tap80e627df-b7"/>
Nov 28 18:35:59 user nova-compute[75203]:     </interface>
Nov 28 18:35:59 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:35:59 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/console.log" append="off"/>
Nov 28 18:35:59 user nova-compute[75203]:     </serial>
Nov 28 18:35:59 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:35:59 user nova-compute[75203]:     <video>
Nov 28 18:35:59 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:35:59 user nova-compute[75203]:     </video>
Nov 28 18:35:59 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:35:59 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:35:59 user nova-compute[75203]:     </rng>
Nov 28 18:35:59 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:35:59 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:35:59 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:35:59 user nova-compute[75203]:     </memballoon>
Nov 28 18:35:59 user nova-compute[75203]:   </devices>
Nov 28 18:35:59 user nova-compute[75203]: </domain>
Nov 28 18:35:59 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2141242460',display_name='tempest-TestServerVolumeAttachmentScenario-server-2141242460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2141242460',id=12,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXiig/ft+B2jr5SVTsnP+QQEXnzqbcBQPl55+4MzFT+j4CvH5nduKO2t460YjFPRzfUMgPZJYmuJmWWeWcJIkcFSlMadPe6TD7poay7gIAyQ6XFyXpzIiOzKhBEgG6Nug==',key_name='tempest-keypair-47000978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3d89c2f27be453c810b8ea57efbc921',ramdisk_id='',reservation_id='r-mukwt9f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1676841860',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1676841860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7651a46356c14d6690c6422cc778187b',uuid=eec19476-5b8e-4d91-b0e3-6ecd0986632d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Converting VIF {"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:98:94,bridge_name='br-int',has_traffic_filtering=True,id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb,network=Network(2863569b-7646-4eaa-88d4-eede654c5597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e627df-b7') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG os_vif [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:98:94,bridge_name='br-int',has_traffic_filtering=True,id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb,network=Network(2863569b-7646-4eaa-88d4-eede654c5597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e627df-b7') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71d2dd9a-a248-5506-9eeb-e04f14746ba2', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:35:59 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port 5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80e627df-b7, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80e627df-b7, col_values=(('qos', UUID('12797914-c5c7-412e-8b3d-b2fefb88327d')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80e627df-b7, col_values=(('external_ids', {'iface-id': '80e627df-b79d-48cd-8445-3ca7c1cc7eeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:98:94', 'vm-uuid': 'eec19476-5b8e-4d91-b0e3-6ecd0986632d'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:00 user nova-compute[75203]: INFO os_vif [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:98:94,bridge_name='br-int',has_traffic_filtering=True,id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb,network=Network(2863569b-7646-4eaa-88d4-eede654c5597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e627df-b7')
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully updated port: 194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] No VIF found with MAC fa:16:3e:91:98:94, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-changed-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Refreshing instance network info cache due to event network-changed-80e627df-b79d-48cd-8445-3ca7c1cc7eeb. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Acquiring lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Acquired lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Refreshing network info cache for port 80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updated VIF entry in instance network info cache for port 80e627df-b79d-48cd-8445-3ca7c1cc7eeb. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updating instance_info_cache with network_info: [{"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully updated port: 7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:36:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7b281b9-cf30-4a87-8e36-b1d99e3a3111 req-f59a2c84-b850-43e1-85e5-f11924c35041 service nova] Releasing lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Successfully updated port: 8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-194b8b2c-3e49-4713-983b-255bddb7c462. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-8a66165f-e67d-44b6-b735-c02963cb5601 req-57821944-57e8-4be3-86ca-7ed41ba3a049 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8a66165f-e67d-44b6-b735-c02963cb5601 req-57821944-57e8-4be3-86ca-7ed41ba3a049 service nova] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8a66165f-e67d-44b6-b735-c02963cb5601 req-57821944-57e8-4be3-86ca-7ed41ba3a049 service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8a66165f-e67d-44b6-b735-c02963cb5601 req-57821944-57e8-4be3-86ca-7ed41ba3a049 service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-8a66165f-e67d-44b6-b735-c02963cb5601 req-57821944-57e8-4be3-86ca-7ed41ba3a049 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] No waiting events found dispatching network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:01 user nova-compute[75203]: WARNING nova.compute.manager [req-8a66165f-e67d-44b6-b735-c02963cb5601 req-57821944-57e8-4be3-86ca-7ed41ba3a049 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received unexpected event network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb for instance with vm_state building and task_state spawning.
Nov 28 18:36:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance network_info: |[{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:36:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:03 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port 194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-e1647b84-dd34-4233-a54d-90f6f4798d43 req-14133f8c-cb54-497c-825a-b8e8ef64008d service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e1647b84-dd34-4233-a54d-90f6f4798d43 req-14133f8c-cb54-497c-825a-b8e8ef64008d service nova] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e1647b84-dd34-4233-a54d-90f6f4798d43 req-14133f8c-cb54-497c-825a-b8e8ef64008d service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e1647b84-dd34-4233-a54d-90f6f4798d43 req-14133f8c-cb54-497c-825a-b8e8ef64008d service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-e1647b84-dd34-4233-a54d-90f6f4798d43 req-14133f8c-cb54-497c-825a-b8e8ef64008d service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] No waiting events found dispatching network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:04 user nova-compute[75203]: WARNING nova.compute.manager [req-e1647b84-dd34-4233-a54d-90f6f4798d43 req-14133f8c-cb54-497c-825a-b8e8ef64008d service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received unexpected event network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb for instance with vm_state building and task_state spawning.
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updated VIF entry in instance network info cache for port 194b8b2c-3e49-4713-983b-255bddb7c462. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port 7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:36:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Instance spawned successfully.
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:04 user nova-compute[75203]: INFO nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Took 7.67 seconds to spawn the instance on the hypervisor.
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:36:04 user nova-compute[75203]: INFO nova.compute.manager [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Took 8.74 seconds to build instance.
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e2e0c8-2a9c-44c8-b98e-f0c840bb6706 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.870s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updated VIF entry in instance network info cache for port 7c28d389-5c32-435b-8ca5-2d6ecfaf03a2. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-8e2db7ae-c549-4368-852e-68494ac2f978. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port 8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:05 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updated VIF entry in instance network info cache for port 8e2db7ae-c549-4368-852e-68494ac2f978. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:05 user nova-compute[75203]: DEBUG nova.network.neutron [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cac7dd28-0514-415c-adc3-f400e61d1929 req-b9c9a4c0-735f-4e77-b3db-8ca9f63f5218 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:06 user nova-compute[75203]: INFO nova.virt.block_device [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Booting with volume 45d2bb99-ea26-4c9d-91a7-349afd3dc36e at /dev/vdb
Nov 28 18:36:06 user nova-compute[75203]: DEBUG os_brick.utils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2c7e20-8a10-4840-82ec-342699063dce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[897c9d9c-1b24-443f-9281-32a017902d19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e78f7-58c7-4edc-b5d7-989957508eca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cc1952-69d8-4745-a307-93348d1e405e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:06 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:36:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de40207-87fc-4fe4-8b53-9092e2577190]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG os_brick.utils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:06 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating existing volume attachment record: 0e9eb0a5-c5a6-4cc5-a10e-6a4af8ddfc84 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:36:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:17 user nova-compute[75203]: INFO nova.virt.block_device [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Booting with volume 17d8fca9-e25f-4caf-8b8d-7130e4dd7058 at /dev/vdc
Nov 28 18:36:18 user nova-compute[75203]: DEBUG os_brick.utils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c70f9a-7cf4-4a72-9b48-9745d1bcc12f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c316d900-7e9d-4c6b-be77-e386dcd08109]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[54322f63-5f5d-432b-953e-82928cde9a50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ec634a-e50f-4d5c-b6fd-23a1d687fe55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:18 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:36:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd48586-5c22-4698-b53f-b9bb61cb4d63]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG os_brick.utils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:18 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating existing volume attachment record: ae8e79de-5c81-4397-ae9f-b1b92d3817c4 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:36:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:36:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Creating image(s)
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Ensure instance console log exists: /opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Start _get_guest_xml network_info=[{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQhTMzPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16c72606-ed4c-4c7a-8295-a76da36da957', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbd80f90-116f-44ba-913b-955f4d331daf', 'serial': 'dbd80f90-116f-44ba-913b-955f4d331daf'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'a8788633-c0ef-456b-b8f8-1875f13f49b6', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvoaHRfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16c72606-ed4c-4c7a-8295-a76da36da957', 'attached_at': '', 'detached_at': '', 'volume_id': '45d2bb99-ea26-4c9d-91a7-349afd3dc36e', 'serial': '45d2bb99-ea26-4c9d-91a7-349afd3dc36e'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '0e9eb0a5-c5a6-4cc5-a10e-6a4af8ddfc84', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIvMLmHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16c72606-ed4c-4c7a-8295-a76da36da957', 'attached_at': '', 'detached_at': '', 'volume_id': '17d8fca9-e25f-4caf-8b8d-7130e4dd7058', 'serial': '17d8fca9-e25f-4caf-8b8d-7130e4dd7058'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': 'ae8e79de-5c81-4397-ae9f-b1b92d3817c4', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:36:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:36:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQhTMzPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:28 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:28 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:28 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547afc9-33b0-4ba9-89be-e2f8a568634e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:36:28 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ef7a2d-47f1-4d07-b99b-51f4cb4ce26c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf] added
Nov 28 18:36:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7607fec-080f-45ad-847b-f645d35c4ff9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[de70ca6a-cb25-4100-a90b-1d69672813d4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQhTMzPG {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQhTMzPG" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e677a716-8dc4-4e29-80cd-eadb34c964f1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQhTMzPG'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3485b606-c11c-4b9e-acf5-9fb86d2f0014]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf5609d-6095-4822-8741-a07f8f69912e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6e9853-0629-49d0-8068-683c08bb3f19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260]
Nov 28 18:36:28 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260] successful.
Nov 28 18:36:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a727a4c-0bc2-428f-b73e-c4f85f27a83c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[da466793-21ad-4cb8-9a5a-6c8394879b6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:28 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:28 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a416975a-63e4-4bbf-b0db-efc636fc5e21]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQhTMzPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23732653631346532', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732653631346532', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvoaHRfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:29 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:29 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:29 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4bb71b-cae3-4de6-94f9-4dc8f8d1845d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:36:29 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[37450907-57c4-4a47-9244-c979178515a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e] added
Nov 28 18:36:29 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a340648-fb53-4cbb-8418-2c2e20670f75]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7295ffdb-d01d-4b97-9b53-645708355339]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvoaHRfU {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvoaHRfU" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45a2d2-366b-42bc-977b-26e4d176a923]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvoaHRfU'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e356f4eb-8163-4fd5-a87b-374bd0eed386]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c068ab7-04a8-4e13-82ee-6ae4b17d4e5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:29 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:29 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:29 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:29 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c256da-2b59-47bd-b34f-ceecf7534dcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260]
Nov 28 18:36:30 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260] successful.
Nov 28 18:36:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e10a479-ea81-4c98-9677-93ca2353a6f5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e775a-2c8b-473d-b8d7-166eab5d9464]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:30 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:30 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:30 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:30 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f1dbb-4ad8-4c4e-b7d7-c99a7639631d]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:36:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvoaHRfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26262363235393835', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262363235393835', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIvMLmHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:31 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:31 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:31 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d84a9-972b-41d4-b06c-0238d8f6b60a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:36:31 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa5f2da-fe75-4f18-9a9a-b24a9a9290f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058] added
Nov 28 18:36:31 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e6a4b-6660-4bb7-afc9-e3ed7fd5dae9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e55445-7a2a-461f-8ca9-ddeb112270ca]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIvMLmHk {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIvMLmHk" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[20030d88-f2df-4fc9-ad33-939f3d496261]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GIvMLmHk'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e7520-428b-4e41-ace5-a15debc83ffd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb23d08-3b93-458d-a6fa-3330b2aa5973]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:31 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:31 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacbc3f1-f80a-455c-a75e-1bc01bd2e485]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260]
Nov 28 18:36:31 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260] successful.
Nov 28 18:36:31 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0475a4d-a836-428f-bdc7-02d500e3bf48]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2e7b12-ba23-4a81-bb8d-80c252f75b62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:31 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:31 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:31 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b90ca7-685c-4396-b74e-dd2d8fcdc999]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:31 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIvMLmHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26638376230633163', 'path': '/dev/sde'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638376230633163', 'path': '/dev/sde'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a6:56,bridge_name='br-int',has_traffic_filtering=True,id=9d8bae68-1062-4edb-b1b3-27ff8b55b225,network=Network(d75fd7cf-22c0-4e71-bfe1-899659f543a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8bae68-10') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:0b,bridge_name='br-int',has_traffic_filtering=True,id=d28852c4-aebd-4cc2-af45-f02e6b6226b7,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd28852c4-ae') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=986fa26d-73d2-4879-9213-2adb023290d8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986fa26d-73') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:51,bridge_name='br-int',has_traffic_filtering=True,id=5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4c741b-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=194b8b2c-3e49-4713-983b-255bddb7c462,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194b8b2c-3e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c9:39,bridge_name='br-int',has_traffic_filtering=True,id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c28d389-5c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=8e2db7ae-c549-4368-852e-68494ac2f978,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2db7ae-c5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.objects.instance [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lazy-loading 'pci_devices' on Instance uuid 16c72606-ed4c-4c7a-8295-a76da36da957 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:36:32 user nova-compute[75203]:   <uuid>16c72606-ed4c-4c7a-8295-a76da36da957</uuid>
Nov 28 18:36:32 user nova-compute[75203]:   <name>instance-0000000b</name>
Nov 28 18:36:32 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:36:32 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:36:32 user nova-compute[75203]:   <metadata>
Nov 28 18:36:32 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:36:32 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:36:32 user nova-compute[75203]:       <nova:name>tempest-device-tagging-server-1812232109</nova:name>
Nov 28 18:36:32 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:36:28</nova:creationTime>
Nov 28 18:36:32 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:36:32 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:36:32 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:36:32 user nova-compute[75203]:       <nova:owner>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:user uuid="0855ea71a4084541936c00003279c26d">tempest-TaggedBootDevicesTest-1004375661-project-member</nova:user>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:project uuid="730532d801394235950dc0a30cf94733">tempest-TaggedBootDevicesTest-1004375661</nova:project>
Nov 28 18:36:32 user nova-compute[75203]:       </nova:owner>
Nov 28 18:36:32 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:36:32 user nova-compute[75203]:       <nova:ports>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:port uuid="9d8bae68-1062-4edb-b1b3-27ff8b55b225">
Nov 28 18:36:32 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 18:36:32 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:port uuid="d28852c4-aebd-4cc2-af45-f02e6b6226b7">
Nov 28 18:36:32 user nova-compute[75203]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Nov 28 18:36:32 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:port uuid="986fa26d-73d2-4879-9213-2adb023290d8">
Nov 28 18:36:32 user nova-compute[75203]:           <nova:ip type="fixed" address="10.1.1.42" ipVersion="4"/>
Nov 28 18:36:32 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:port uuid="5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8">
Nov 28 18:36:32 user nova-compute[75203]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Nov 28 18:36:32 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:port uuid="194b8b2c-3e49-4713-983b-255bddb7c462">
Nov 28 18:36:32 user nova-compute[75203]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Nov 28 18:36:32 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:port uuid="7c28d389-5c32-435b-8ca5-2d6ecfaf03a2">
Nov 28 18:36:32 user nova-compute[75203]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 28 18:36:32 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:32 user nova-compute[75203]:         <nova:port uuid="8e2db7ae-c549-4368-852e-68494ac2f978">
Nov 28 18:36:32 user nova-compute[75203]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 28 18:36:32 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:32 user nova-compute[75203]:       </nova:ports>
Nov 28 18:36:32 user nova-compute[75203]:     </nova:instance>
Nov 28 18:36:32 user nova-compute[75203]:   </metadata>
Nov 28 18:36:32 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:36:32 user nova-compute[75203]:     <system>
Nov 28 18:36:32 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:36:32 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:36:32 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:36:32 user nova-compute[75203]:       <entry name="serial">16c72606-ed4c-4c7a-8295-a76da36da957</entry>
Nov 28 18:36:32 user nova-compute[75203]:       <entry name="uuid">16c72606-ed4c-4c7a-8295-a76da36da957</entry>
Nov 28 18:36:32 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:36:32 user nova-compute[75203]:     </system>
Nov 28 18:36:32 user nova-compute[75203]:   </sysinfo>
Nov 28 18:36:32 user nova-compute[75203]:   <os>
Nov 28 18:36:32 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:36:32 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:36:32 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:36:32 user nova-compute[75203]:   </os>
Nov 28 18:36:32 user nova-compute[75203]:   <features>
Nov 28 18:36:32 user nova-compute[75203]:     <acpi/>
Nov 28 18:36:32 user nova-compute[75203]:     <apic/>
Nov 28 18:36:32 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:36:32 user nova-compute[75203]:   </features>
Nov 28 18:36:32 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:36:32 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:36:32 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:36:32 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:36:32 user nova-compute[75203]:   </clock>
Nov 28 18:36:32 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:36:32 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:36:32 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:36:32 user nova-compute[75203]:   </cpu>
Nov 28 18:36:32 user nova-compute[75203]:   <devices>
Nov 28 18:36:32 user nova-compute[75203]:     <disk type="file" device="cdrom">
Nov 28 18:36:32 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 18:36:32 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957/disk.config"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="hda" bus="ide"/>
Nov 28 18:36:32 user nova-compute[75203]:     </disk>
Nov 28 18:36:32 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:36:32 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:36:32 user nova-compute[75203]:       <source dev="/dev/sdc"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <serial>dbd80f90-116f-44ba-913b-955f4d331daf</serial>
Nov 28 18:36:32 user nova-compute[75203]:     </disk>
Nov 28 18:36:32 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:36:32 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:36:32 user nova-compute[75203]:       <source dev="/dev/sdd"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <serial>45d2bb99-ea26-4c9d-91a7-349afd3dc36e</serial>
Nov 28 18:36:32 user nova-compute[75203]:     </disk>
Nov 28 18:36:32 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:36:32 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:36:32 user nova-compute[75203]:       <source dev="/dev/sde"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="vdc" bus="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <serial>17d8fca9-e25f-4caf-8b8d-7130e4dd7058</serial>
Nov 28 18:36:32 user nova-compute[75203]:     </disk>
Nov 28 18:36:32 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:32 user nova-compute[75203]:       <mac address="fa:16:3e:39:a6:56"/>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="tap9d8bae68-10"/>
Nov 28 18:36:32 user nova-compute[75203]:     </interface>
Nov 28 18:36:32 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:32 user nova-compute[75203]:       <mac address="fa:16:3e:08:6f:0b"/>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="tapd28852c4-ae"/>
Nov 28 18:36:32 user nova-compute[75203]:     </interface>
Nov 28 18:36:32 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:32 user nova-compute[75203]:       <mac address="fa:16:3e:37:38:ab"/>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="tap986fa26d-73"/>
Nov 28 18:36:32 user nova-compute[75203]:     </interface>
Nov 28 18:36:32 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:32 user nova-compute[75203]:       <mac address="fa:16:3e:b4:80:51"/>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="tap5b4c741b-1d"/>
Nov 28 18:36:32 user nova-compute[75203]:     </interface>
Nov 28 18:36:32 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:32 user nova-compute[75203]:       <mac address="fa:16:3e:be:4e:67"/>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="tap194b8b2c-3e"/>
Nov 28 18:36:32 user nova-compute[75203]:     </interface>
Nov 28 18:36:32 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:32 user nova-compute[75203]:       <mac address="fa:16:3e:00:c9:39"/>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="tap7c28d389-5c"/>
Nov 28 18:36:32 user nova-compute[75203]:     </interface>
Nov 28 18:36:32 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:32 user nova-compute[75203]:       <mac address="fa:16:3e:32:e7:01"/>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:32 user nova-compute[75203]:       <target dev="tap8e2db7ae-c5"/>
Nov 28 18:36:32 user nova-compute[75203]:     </interface>
Nov 28 18:36:32 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:36:32 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957/console.log" append="off"/>
Nov 28 18:36:32 user nova-compute[75203]:     </serial>
Nov 28 18:36:32 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:36:32 user nova-compute[75203]:     <video>
Nov 28 18:36:32 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:32 user nova-compute[75203]:     </video>
Nov 28 18:36:32 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:36:32 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:36:32 user nova-compute[75203]:     </rng>
Nov 28 18:36:32 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:36:32 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:36:32 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:36:32 user nova-compute[75203]:     </memballoon>
Nov 28 18:36:32 user nova-compute[75203]:   </devices>
Nov 28 18:36:32 user nova-compute[75203]: </domain>
Nov 28 18:36:32 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:a6:56,bridge_name='br-int',has_traffic_filtering=True,id=9d8bae68-1062-4edb-b1b3-27ff8b55b225,network=Network(d75fd7cf-22c0-4e71-bfe1-899659f543a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8bae68-10') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a6:56,bridge_name='br-int',has_traffic_filtering=True,id=9d8bae68-1062-4edb-b1b3-27ff8b55b225,network=Network(d75fd7cf-22c0-4e71-bfe1-899659f543a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8bae68-10') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '045bf03b-4f64-5a47-a80b-0968385537ee', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d8bae68-10, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d8bae68-10, col_values=(('qos', UUID('a5296304-0814-42bf-b20d-832b7b2d985f')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d8bae68-10, col_values=(('external_ids', {'iface-id': '9d8bae68-1062-4edb-b1b3-27ff8b55b225', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:a6:56', 'vm-uuid': '16c72606-ed4c-4c7a-8295-a76da36da957'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: INFO os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:a6:56,bridge_name='br-int',has_traffic_filtering=True,id=9d8bae68-1062-4edb-b1b3-27ff8b55b225,network=Network(d75fd7cf-22c0-4e71-bfe1-899659f543a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8bae68-10')
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:0b,bridge_name='br-int',has_traffic_filtering=True,id=d28852c4-aebd-4cc2-af45-f02e6b6226b7,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd28852c4-ae') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:0b,bridge_name='br-int',has_traffic_filtering=True,id=d28852c4-aebd-4cc2-af45-f02e6b6226b7,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd28852c4-ae') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab3b42da-6abf-5f03-b9fb-6460a281aa64', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd28852c4-ae, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd28852c4-ae, col_values=(('qos', UUID('e277dc67-bddc-4e24-8764-abfd76d8bf89')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd28852c4-ae, col_values=(('external_ids', {'iface-id': 'd28852c4-aebd-4cc2-af45-f02e6b6226b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:6f:0b', 'vm-uuid': '16c72606-ed4c-4c7a-8295-a76da36da957'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: INFO os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:0b,bridge_name='br-int',has_traffic_filtering=True,id=d28852c4-aebd-4cc2-af45-f02e6b6226b7,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd28852c4-ae')
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=986fa26d-73d2-4879-9213-2adb023290d8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986fa26d-73') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=986fa26d-73d2-4879-9213-2adb023290d8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986fa26d-73') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85f56756-8ed5-5122-984c-f2c540180234', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap986fa26d-73, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap986fa26d-73, col_values=(('qos', UUID('c80fcf51-3e1e-4029-8326-142f6e85d73e')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap986fa26d-73, col_values=(('external_ids', {'iface-id': '986fa26d-73d2-4879-9213-2adb023290d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:38:ab', 'vm-uuid': '16c72606-ed4c-4c7a-8295-a76da36da957'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: INFO os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=986fa26d-73d2-4879-9213-2adb023290d8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986fa26d-73')
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:51,bridge_name='br-int',has_traffic_filtering=True,id=5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4c741b-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:51,bridge_name='br-int',has_traffic_filtering=True,id=5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4c741b-1d') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '592e0a9d-b8df-5a6f-b940-4e110e7987c8', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b4c741b-1d, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b4c741b-1d, col_values=(('qos', UUID('ccee6161-e10b-4e7e-aa83-e5cfcb2af664')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b4c741b-1d, col_values=(('external_ids', {'iface-id': '5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:80:51', 'vm-uuid': '16c72606-ed4c-4c7a-8295-a76da36da957'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: INFO os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:51,bridge_name='br-int',has_traffic_filtering=True,id=5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4c741b-1d')
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=194b8b2c-3e49-4713-983b-255bddb7c462,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194b8b2c-3e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=194b8b2c-3e49-4713-983b-255bddb7c462,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194b8b2c-3e') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d232da6-8ffc-5337-9295-d6dc7b0dfcbc', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap194b8b2c-3e, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap194b8b2c-3e, col_values=(('qos', UUID('e5cc7cc1-ebf8-444e-94d2-09676dcdac7f')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap194b8b2c-3e, col_values=(('external_ids', {'iface-id': '194b8b2c-3e49-4713-983b-255bddb7c462', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:4e:67', 'vm-uuid': '16c72606-ed4c-4c7a-8295-a76da36da957'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: INFO os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=194b8b2c-3e49-4713-983b-255bddb7c462,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194b8b2c-3e')
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c9:39,bridge_name='br-int',has_traffic_filtering=True,id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c28d389-5c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c9:39,bridge_name='br-int',has_traffic_filtering=True,id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c28d389-5c') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be2d7b7e-f201-5853-9229-b1c93c923a33', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c28d389-5c, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c28d389-5c, col_values=(('qos', UUID('ad465ab5-1baa-4033-9b90-3d11c2fb0c69')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c28d389-5c, col_values=(('external_ids', {'iface-id': '7c28d389-5c32-435b-8ca5-2d6ecfaf03a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:c9:39', 'vm-uuid': '16c72606-ed4c-4c7a-8295-a76da36da957'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: INFO os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c9:39,bridge_name='br-int',has_traffic_filtering=True,id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c28d389-5c')
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=8e2db7ae-c549-4368-852e-68494ac2f978,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2db7ae-c5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=8e2db7ae-c549-4368-852e-68494ac2f978,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2db7ae-c5') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7791fec5-d8b2-5258-a6b2-4479c281b3d7', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e2db7ae-c5, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e2db7ae-c5, col_values=(('qos', UUID('74cd9612-9e48-4d06-9de2-ba341ec293c9')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e2db7ae-c5, col_values=(('external_ids', {'iface-id': '8e2db7ae-c549-4368-852e-68494ac2f978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:e7:01', 'vm-uuid': '16c72606-ed4c-4c7a-8295-a76da36da957'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:33 user nova-compute[75203]: INFO os_vif [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=8e2db7ae-c549-4368-852e-68494ac2f978,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2db7ae-c5')
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] No BDM found with device name hda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] No VIF found with MAC fa:16:3e:39:a6:56, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] No VIF found with MAC fa:16:3e:be:4e:67, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:36:33 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Using config drive
Nov 28 18:36:33 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Creating config drive at /opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957/disk.config
Nov 28 18:36:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0xh3cn0m {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0xh3cn0m" returned: 0 in 0.057s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:34 user nova-compute[75203]: INFO nova.compute.manager [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Rescuing
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lazy-loading 'flavor' on Instance uuid b48f122d-af9c-400c-8a7a-0c1303cc0cb8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:34 user nova-compute[75203]: INFO nova.compute.manager [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Attaching volume 54bbefe5-b07a-44df-8909-5108cc96d05a to /dev/vdb
Nov 28 18:36:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updating instance_info_cache with network_info: [{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG os_brick.utils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e95d38-0abe-4605-a75f-dc70833294a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf345ce0-7a19-402d-8fe7-7500c3bea856]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd84f8b-931d-4a52-8cf3-ce1c5a9c6592]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e94521-ba78-45a6-a637-4eb298ce01bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:34 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:36:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7e709d-1775-4f3b-b05b-152960040d1e]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG os_brick.utils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:34 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updating existing volume attachment record: 66944ba0-90ff-4e84-a850-0130e01625f4 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-8401dbd7-4a6b-4264-83fe-383b714e406f req-85d44911-7956-4049-9f4b-68c18506475b service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-unplugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8401dbd7-4a6b-4264-83fe-383b714e406f req-85d44911-7956-4049-9f4b-68c18506475b service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8401dbd7-4a6b-4264-83fe-383b714e406f req-85d44911-7956-4049-9f4b-68c18506475b service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8401dbd7-4a6b-4264-83fe-383b714e406f req-85d44911-7956-4049-9f4b-68c18506475b service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-8401dbd7-4a6b-4264-83fe-383b714e406f req-85d44911-7956-4049-9f4b-68c18506475b service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-unplugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:35 user nova-compute[75203]: WARNING nova.compute.manager [req-8401dbd7-4a6b-4264-83fe-383b714e406f req-85d44911-7956-4049-9f4b-68c18506475b service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received unexpected event network-vif-unplugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with vm_state active and task_state rescuing.
Nov 28 18:36:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-578c7052-c65f-4a1a-be55-250e32ac9240 req-e7480528-bd6b-4da7-bc23-8e7199b5e268 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-578c7052-c65f-4a1a-be55-250e32ac9240 req-e7480528-bd6b-4da7-bc23-8e7199b5e268 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-578c7052-c65f-4a1a-be55-250e32ac9240 req-e7480528-bd6b-4da7-bc23-8e7199b5e268 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-578c7052-c65f-4a1a-be55-250e32ac9240 req-e7480528-bd6b-4da7-bc23-8e7199b5e268 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-578c7052-c65f-4a1a-be55-250e32ac9240 req-e7480528-bd6b-4da7-bc23-8e7199b5e268 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:35 user nova-compute[75203]: WARNING nova.compute.manager [req-578c7052-c65f-4a1a-be55-250e32ac9240 req-e7480528-bd6b-4da7-bc23-8e7199b5e268 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 for instance with vm_state building and task_state spawning.
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-5a9576b8-b356-46c4-afbb-9ca6f117266e req-588ba902-dddc-4599-90da-f771b8f1c697 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5a9576b8-b356-46c4-afbb-9ca6f117266e req-588ba902-dddc-4599-90da-f771b8f1c697 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5a9576b8-b356-46c4-afbb-9ca6f117266e req-588ba902-dddc-4599-90da-f771b8f1c697 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5a9576b8-b356-46c4-afbb-9ca6f117266e req-588ba902-dddc-4599-90da-f771b8f1c697 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-5a9576b8-b356-46c4-afbb-9ca6f117266e req-588ba902-dddc-4599-90da-f771b8f1c697 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:35 user nova-compute[75203]: WARNING nova.compute.manager [req-5a9576b8-b356-46c4-afbb-9ca6f117266e req-588ba902-dddc-4599-90da-f771b8f1c697 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 for instance with vm_state building and task_state spawning.
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance destroyed successfully.
Nov 28 18:36:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Attempting rescue
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75203) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:36:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Creating image(s)
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'trusted_certs' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.217s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue" returned: 0 in 0.064s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'migration_context' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.base [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<017ccf79-0df6-4fb7-a551-0b67f8e6afe3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Start _get_guest_xml network_info=[{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:f4:cf:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'resources' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.base [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<017ccf79-0df6-4fb7-a551-0b67f8e6afe3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'numa_topology' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.base [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<017ccf79-0df6-4fb7-a551-0b67f8e6afe3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:36:36 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:36:36 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'vcpu_model' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.base [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<017ccf79-0df6-4fb7-a551-0b67f8e6afe3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1112017727',display_name='tempest-ServerRescueNegativeTestJSON-server-1112017727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1112017727',id=3,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-39ifyl7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:04Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=017ccf79-0df6-4fb7-a551-0b67f8e6afe3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:f4:cf:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:f4:cf:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'pci_devices' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.objects.base [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<017ccf79-0df6-4fb7-a551-0b67f8e6afe3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:36:36 user nova-compute[75203]:   <uuid>017ccf79-0df6-4fb7-a551-0b67f8e6afe3</uuid>
Nov 28 18:36:36 user nova-compute[75203]:   <name>instance-00000003</name>
Nov 28 18:36:36 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:36:36 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:36:36 user nova-compute[75203]:   <metadata>
Nov 28 18:36:36 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:36:36 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:36:36 user nova-compute[75203]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1112017727</nova:name>
Nov 28 18:36:36 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:36:36</nova:creationTime>
Nov 28 18:36:36 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:36:36 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:36:36 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:36:36 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:36:36 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:36:36 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:36:36 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:36:36 user nova-compute[75203]:       <nova:owner>
Nov 28 18:36:36 user nova-compute[75203]:         <nova:user uuid="f96761cb11ad45b0bbc9a0435d3c0324">tempest-ServerRescueNegativeTestJSON-2096861107-project-member</nova:user>
Nov 28 18:36:36 user nova-compute[75203]:         <nova:project uuid="13d19b759f9948c9be9be5097069099b">tempest-ServerRescueNegativeTestJSON-2096861107</nova:project>
Nov 28 18:36:36 user nova-compute[75203]:       </nova:owner>
Nov 28 18:36:36 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:36:36 user nova-compute[75203]:       <nova:ports>
Nov 28 18:36:36 user nova-compute[75203]:         <nova:port uuid="e4a48b3f-3cd4-47b0-afa2-57e955dceeff">
Nov 28 18:36:36 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:36:36 user nova-compute[75203]:         </nova:port>
Nov 28 18:36:36 user nova-compute[75203]:       </nova:ports>
Nov 28 18:36:36 user nova-compute[75203]:     </nova:instance>
Nov 28 18:36:36 user nova-compute[75203]:   </metadata>
Nov 28 18:36:36 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:36:36 user nova-compute[75203]:     <system>
Nov 28 18:36:36 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:36:36 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:36:36 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:36:36 user nova-compute[75203]:       <entry name="serial">017ccf79-0df6-4fb7-a551-0b67f8e6afe3</entry>
Nov 28 18:36:36 user nova-compute[75203]:       <entry name="uuid">017ccf79-0df6-4fb7-a551-0b67f8e6afe3</entry>
Nov 28 18:36:36 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:36:36 user nova-compute[75203]:     </system>
Nov 28 18:36:36 user nova-compute[75203]:   </sysinfo>
Nov 28 18:36:36 user nova-compute[75203]:   <os>
Nov 28 18:36:36 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:36:36 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:36:36 user nova-compute[75203]:   </os>
Nov 28 18:36:36 user nova-compute[75203]:   <features>
Nov 28 18:36:36 user nova-compute[75203]:     <acpi/>
Nov 28 18:36:36 user nova-compute[75203]:     <apic/>
Nov 28 18:36:36 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:36:36 user nova-compute[75203]:   </features>
Nov 28 18:36:36 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:36:36 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:36:36 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:36:36 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:36:36 user nova-compute[75203]:   </clock>
Nov 28 18:36:36 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:36:36 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:36:36 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:36:36 user nova-compute[75203]:   </cpu>
Nov 28 18:36:36 user nova-compute[75203]:   <devices>
Nov 28 18:36:36 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:36:36 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:36:36 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue"/>
Nov 28 18:36:36 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:36:36 user nova-compute[75203]:     </disk>
Nov 28 18:36:36 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:36:36 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:36:36 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk"/>
Nov 28 18:36:36 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:36:36 user nova-compute[75203]:     </disk>
Nov 28 18:36:36 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:36:36 user nova-compute[75203]:       <mac address="fa:16:3e:f4:cf:2b"/>
Nov 28 18:36:36 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:36 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:36:36 user nova-compute[75203]:       <target dev="tape4a48b3f-3c"/>
Nov 28 18:36:36 user nova-compute[75203]:     </interface>
Nov 28 18:36:36 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:36:36 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/console.log" append="off"/>
Nov 28 18:36:36 user nova-compute[75203]:     </serial>
Nov 28 18:36:36 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:36:36 user nova-compute[75203]:     <video>
Nov 28 18:36:36 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:36:36 user nova-compute[75203]:     </video>
Nov 28 18:36:36 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:36:36 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:36:36 user nova-compute[75203]:     </rng>
Nov 28 18:36:36 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:36:36 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:36:36 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:36:36 user nova-compute[75203]:     </memballoon>
Nov 28 18:36:36 user nova-compute[75203]:   </devices>
Nov 28 18:36:36 user nova-compute[75203]: </domain>
Nov 28 18:36:36 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:36:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance destroyed successfully.
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No VIF found with MAC fa:16:3e:f4:cf:2b, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-changed-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Refreshing instance network info cache due to event network-changed-e926ef4f-c658-45e4-9a84-0368130c6bcb. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] Acquiring lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] Acquired lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG nova.network.neutron [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Refreshing network info cache for port e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:37 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-d1b2a853-4f12-424e-a65b-8596a4ef87ff req-3d734db0-223e-4dac-aed7-1735aca10a4a service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-e7e836fb-8427-4152-9443-20014cda4f8a req-48d8c6ba-225a-406a-9823-9fe1e45e577f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 for instance with vm_state building and task_state spawning.
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updated VIF entry in instance network info cache for port e926ef4f-c658-45e4-9a84-0368130c6bcb. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] Releasing lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:38 user nova-compute[75203]: WARNING nova.compute.manager [req-7a774a75-60ec-445f-9505-a1889a542250 req-3006b263-ef11-4135-902c-3958eec8ace9 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received unexpected event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with vm_state active and task_state rescuing.
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:39 user nova-compute[75203]: WARNING nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 for instance with vm_state building and task_state spawning.
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:39 user nova-compute[75203]: WARNING nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 for instance with vm_state building and task_state spawning.
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:39 user nova-compute[75203]: WARNING nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received unexpected event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with vm_state active and task_state rescuing.
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:39 user nova-compute[75203]: WARNING nova.compute.manager [req-df75a287-ac66-4f25-b5b4-c29c1df96af6 req-0c666660-0e16-4b9d-82a9-812dd8d9f9a1 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received unexpected event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with vm_state active and task_state rescuing.
Nov 28 18:36:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-c0862884-6e31-430e-9400-e70b9c673b5a req-363af8ea-d50e-46b5-ba76-356f5c46a319 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c0862884-6e31-430e-9400-e70b9c673b5a req-363af8ea-d50e-46b5-ba76-356f5c46a319 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c0862884-6e31-430e-9400-e70b9c673b5a req-363af8ea-d50e-46b5-ba76-356f5c46a319 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c0862884-6e31-430e-9400-e70b9c673b5a req-363af8ea-d50e-46b5-ba76-356f5c46a319 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-c0862884-6e31-430e-9400-e70b9c673b5a req-363af8ea-d50e-46b5-ba76-356f5c46a319 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:40 user nova-compute[75203]: WARNING nova.compute.manager [req-c0862884-6e31-430e-9400-e70b9c673b5a req-363af8ea-d50e-46b5-ba76-356f5c46a319 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 for instance with vm_state building and task_state spawning.
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-changed-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Refreshing instance network info cache due to event network-changed-697e8d57-71b4-41ea-87e0-507601444786. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] Acquiring lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] Acquired lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG nova.network.neutron [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Refreshing network info cache for port 697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:40 user nova-compute[75203]: INFO nova.compute.manager [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Shelving
Nov 28 18:36:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:36:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance destroyed successfully.
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updated VIF entry in instance network info cache for port 697e8d57-71b4-41ea-87e0-507601444786. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Beginning cold snapshot process
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1816ba9e-86e7-4898-b7a3-f8041f62297d req-9eb8190b-a802-4b95-85fe-0e2a29651ce6 service nova] Releasing lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-unplugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-unplugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:41 user nova-compute[75203]: WARNING nova.compute.manager [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received unexpected event network-vif-unplugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:41 user nova-compute[75203]: WARNING nova.compute.manager [req-fe814391-abfb-4a4d-8c7c-abb448435fd1 req-f3b01770-4531-4124-b97b-91f78778d51e service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received unexpected event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:36:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk /opt/stack/data/nova/instances/snapshots/tmp2q_r5a55/da04ec3e4dcf4da28bbe61a4831edbbf {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-17cec983-97b3-4990-9f0e-e4502d69b7ca tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:36:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance spawned successfully.
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:42 user nova-compute[75203]: INFO nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Took 13.86 seconds to spawn the instance on the hypervisor.
Nov 28 18:36:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:36:42 user nova-compute[75203]: INFO nova.compute.manager [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Took 53.06 seconds to build instance.
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47e09b75-55cb-4010-9454-9bce1fccb1f0 tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "16c72606-ed4c-4c7a-8295-a76da36da957" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.178s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk /opt/stack/data/nova/instances/snapshots/tmp2q_r5a55/da04ec3e4dcf4da28bbe61a4831edbbf" returned: 0 in 0.920s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Snapshot extracted, beginning image upload
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDxwIckd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:43 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:43 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:43 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60e2de2-b72b-4bdc-87fd-56b0ab2fdf20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:36:43 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[01be51a6-a9fb-43d9-b74b-2433204e522c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a] added
Nov 28 18:36:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155e082-4caf-40e2-8d73-6875abd2c2c4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e1bd5-149e-4c34-bef0-74df3db8d8bb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDxwIckd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDxwIckd" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bc75d4-16cc-4ba7-a66e-f88be6d985e7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDxwIckd'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[728616ba-afd8-4f49-a62f-9e0dfe38339a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[832545b8-c64d-4492-b812-1925dc8917ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189b79e-a9aa-4f27-8bd4-4070d927af08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260]
Nov 28 18:36:43 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260] successful.
Nov 28 18:36:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be34c12-64e7-4b86-bb5e-d1c4fb57215e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ba2a2-84e0-4f8b-97c2-e40b2051fadd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a (non-flash)
Nov 28 18:36:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:43 user nova-compute[75203]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a (non-flash)
Nov 28 18:36:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6b5a4-b4e3-4dcf-9930-30f918266cb2]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDxwIckd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26530376163336238', 'path': '/dev/sdf'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530376163336238', 'path': '/dev/sdf'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lazy-loading 'flavor' on Instance uuid b48f122d-af9c-400c-8a7a-0c1303cc0cb8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:36:44 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:36:44 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:36:44 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:36:44 user nova-compute[75203]:   <serial>54bbefe5-b07a-44df-8909-5108cc96d05a</serial>
Nov 28 18:36:44 user nova-compute[75203]: </disk>
Nov 28 18:36:44 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:36:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:45 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:36:45 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=6906MB free_disk=25.37691879272461GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] No VIF found with MAC fa:16:3e:b7:c0:ba, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b48f122d-af9c-400c-8a7a-0c1303cc0cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 72f841aa-13fb-4373-9225-2df8a700e045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 6663b95e-c45f-4ffc-abba-ca678dbd898e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 16c72606-ed4c-4c7a-8295-a76da36da957 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance eec19476-5b8e-4d91-b0e3-6ecd0986632d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:36:45 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Snapshot image upload complete
Nov 28 18:36:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:36:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b5940773-8130-4303-ad85-0d4fabe5e17c tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.300s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:46 user nova-compute[75203]: INFO nova.compute.manager [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Shelve offloading
Nov 28 18:36:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance destroyed successfully.
Nov 28 18:36:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquired lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Releasing lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:46 user nova-compute[75203]: INFO nova.compute.manager [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Terminating instance
Nov 28 18:36:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-e0472df6-947d-425c-bac9-0d6d56c02b3f req-d1c17d00-efaf-4e3c-a38f-b85e27a82a9b service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received event network-vif-unplugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e0472df6-947d-425c-bac9-0d6d56c02b3f req-d1c17d00-efaf-4e3c-a38f-b85e27a82a9b service nova] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e0472df6-947d-425c-bac9-0d6d56c02b3f req-d1c17d00-efaf-4e3c-a38f-b85e27a82a9b service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e0472df6-947d-425c-bac9-0d6d56c02b3f req-d1c17d00-efaf-4e3c-a38f-b85e27a82a9b service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-e0472df6-947d-425c-bac9-0d6d56c02b3f req-d1c17d00-efaf-4e3c-a38f-b85e27a82a9b service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] No waiting events found dispatching network-vif-unplugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-e0472df6-947d-425c-bac9-0d6d56c02b3f req-d1c17d00-efaf-4e3c-a38f-b85e27a82a9b service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received event network-vif-unplugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Instance destroyed successfully.
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.objects.instance [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lazy-loading 'resources' on Instance uuid b48f122d-af9c-400c-8a7a-0c1303cc0cb8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance destroyed successfully.
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'resources' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-872100218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-872100218',id=4,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4nvbQKLZQHRXKnK4UKQ2N+ciJKLOfdYfF6uSAvLxkWJ4TI1FW+az8XSi54TcE8d2ZxjUPaFAgAgJumTuo0TPmO2dM7yE+IjdzwaqHTdjjZ++KmaUHb3+BF40h8hxTZuQ==',key_name='tempest-keypair-1052442870',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-bvmbn55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member',shelved_at='2023-11-28T18:36:45.972327',shelved_host='user',shelved_image_id='bac2f97d-df05-4d96-be2d-968f48be8d7b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=55c0f8b3-b64d-43d0-9245-730ee9f836fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_vif [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1537440989',display_name='tempest-DeleteServersTestJSON-server-1537440989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1537440989',id=1,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98c3564b61b84ad18e5a52b5a83db952',ramdisk_id='',reservation_id='r-r0o4bs6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1581373654',owner_user_name='tempest-DeleteServersTestJSON-1581373654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:35:04Z,user_data=None,user_id='0c13aa85b0714209b9d5a36b1356b596',uuid=b48f122d-af9c-400c-8a7a-0c1303cc0cb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Converting VIF {"id": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "address": "fa:16:3e:b7:c0:ba", "network": {"id": "80b9ac5a-b87d-45fa-b187-1c2edb345f9c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-66902415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98c3564b61b84ad18e5a52b5a83db952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap376d8ef0-5e", "ovs_interfaceid": "376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:c0:ba,bridge_name='br-int',has_traffic_filtering=True,id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1,network=Network(80b9ac5a-b87d-45fa-b187-1c2edb345f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376d8ef0-5e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_vif [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:c0:ba,bridge_name='br-int',has_traffic_filtering=True,id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1,network=Network(80b9ac5a-b87d-45fa-b187-1c2edb345f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376d8ef0-5e') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape926ef4f-c6, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap376d8ef0-5e, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea1677a2-7204-43c1-bc8f-1cb3a1b242c1) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75fb30eb-b936-4ae0-a9e9-26d60d04fedb) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:36:47 user nova-compute[75203]: INFO os_vif [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6')
Nov 28 18:36:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Deleting instance files /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb_del
Nov 28 18:36:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Deletion of /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb_del complete
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:36:47 user nova-compute[75203]: INFO os_vif [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:c0:ba,bridge_name='br-int',has_traffic_filtering=True,id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1,network=Network(80b9ac5a-b87d-45fa-b187-1c2edb345f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap376d8ef0-5e')
Nov 28 18:36:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDxwIckd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:47 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a5fcea-20fc-4439-a53f-e53394754162]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:36:47 user nova-compute[75203]: No targets found.
Nov 28 18:36:47 user nova-compute[75203]: iSNS:
Nov 28 18:36:47 user nova-compute[75203]: No targets found.
Nov 28 18:36:47 user nova-compute[75203]: STATIC:
Nov 28 18:36:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:36:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:36:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:36:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8
Nov 28 18:36:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:36:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:36:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:36:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:36:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:36:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a
Nov 28 18:36:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:36:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:36:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:36:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:36:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:36:47 user nova-compute[75203]: FIRMWARE:
Nov 28 18:36:47 user nova-compute[75203]: No targets found.
Nov 28 18:36:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:36:47 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:36:47 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2730a7d1-edda-47a0-84bb-8a7f889f3fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75203) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 28 18:36:48 user nova-compute[75203]: INFO nova.virt.libvirt.host [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] UEFI support detected
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00d68a7-e3fa-4028-8be9-01595f226fff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a (non-flash)
Nov 28 18:36:48 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:36:48 user nova-compute[75203]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a (non-flash)
Nov 28 18:36:48 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a03ba320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a'): ({'sdf'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Removing single pathed devices sdf {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Deleted allocations for instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f226d82d-bd34-479f-8ba6-9b5979a600f3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c99b033-463c-474e-99de-30b99a98852d]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Flushing IO for device /dev/sdf {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc655d43-0461-4105-a47d-b6a94f417420]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'numa_topology' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.objects.base [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<55c0f8b3-b64d-43d0-9245-730ee9f836fb> lazy-loaded attributes: resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1da5c23-6c84-4906-b9f3-a0fcdbe39ee3]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb81b2c4-2e84-4bed-af98-2935de7543ce]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ffa8dd-b0a6-4699-b95b-d667001e6d92]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260]
Nov 28 18:36:48 user nova-compute[75203]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a, portal: 172.16.0.220,3260] successful.
Nov 28 18:36:48 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54bbefe5-b07a-44df-8909-5108cc96d05a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b63dd4-2415-49fb-a2f6-bab5371e6a3b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] <== disconnect_volume: return (405ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:36:48 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Deleting instance files /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8_del
Nov 28 18:36:48 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Deletion of /opt/stack/data/nova/instances/b48f122d-af9c-400c-8a7a-0c1303cc0cb8_del complete
Nov 28 18:36:48 user nova-compute[75203]: INFO nova.compute.manager [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ed92d998-8c49-4812-b87f-43f5e7791be0 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.836s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:49 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:49 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Took 0.59 seconds to deallocate network for instance.
Nov 28 18:36:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-320d0c86-f870-4300-a3be-5a5a36749b02 req-64c9c761-351d-40ab-883b-8d3eaa58d369 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received event network-vif-deleted-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:49 user nova-compute[75203]: INFO nova.compute.manager [req-320d0c86-f870-4300-a3be-5a5a36749b02 req-64c9c761-351d-40ab-883b-8d3eaa58d369 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Neutron deleted interface 376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1; detaching it from the instance and deleting it from the info cache
Nov 28 18:36:49 user nova-compute[75203]: DEBUG nova.network.neutron [req-320d0c86-f870-4300-a3be-5a5a36749b02 req-64c9c761-351d-40ab-883b-8d3eaa58d369 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-320d0c86-f870-4300-a3be-5a5a36749b02 req-64c9c761-351d-40ab-883b-8d3eaa58d369 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Detach interface failed, port_id=376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1, reason: Instance b48f122d-af9c-400c-8a7a-0c1303cc0cb8 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:36:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-6eee419b-5fca-464b-ba83-de0e4a44e897 req-d560c84a-4d8b-4bb1-ade6-10f263c3d2a3 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received event network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6eee419b-5fca-464b-ba83-de0e4a44e897 req-d560c84a-4d8b-4bb1-ade6-10f263c3d2a3 service nova] Acquiring lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6eee419b-5fca-464b-ba83-de0e4a44e897 req-d560c84a-4d8b-4bb1-ade6-10f263c3d2a3 service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6eee419b-5fca-464b-ba83-de0e4a44e897 req-d560c84a-4d8b-4bb1-ade6-10f263c3d2a3 service nova] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-6eee419b-5fca-464b-ba83-de0e4a44e897 req-d560c84a-4d8b-4bb1-ade6-10f263c3d2a3 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] No waiting events found dispatching network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:36:49 user nova-compute[75203]: WARNING nova.compute.manager [req-6eee419b-5fca-464b-ba83-de0e4a44e897 req-d560c84a-4d8b-4bb1-ade6-10f263c3d2a3 service nova] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Received unexpected event network-vif-plugged-376d8ef0-5e5d-4d1e-ac50-afbfb66e05f1 for instance with vm_state active and task_state deleting.
Nov 28 18:36:49 user nova-compute[75203]: INFO nova.compute.manager [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] [instance: b48f122d-af9c-400c-8a7a-0c1303cc0cb8] Took 0.90 seconds to detach 1 volumes for instance.
Nov 28 18:36:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:50 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:36:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:36:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:50 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Deleted allocations for instance b48f122d-af9c-400c-8a7a-0c1303cc0cb8
Nov 28 18:36:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e3d7bce4-54c6-491d-b555-cedbac4af531 tempest-DeleteServersTestJSON-1581373654 tempest-DeleteServersTestJSON-1581373654-project-member] Lock "b48f122d-af9c-400c-8a7a-0c1303cc0cb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.759s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-changed-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Refreshing instance network info cache due to event network-changed-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] Acquiring lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] Acquired lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Refreshing network info cache for port 5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updated VIF entry in instance network info cache for port 5718ecd4-ded7-4efb-84a1-a0cfe3fabef3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updating instance_info_cache with network_info: [{"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-50280340-b9a1-4654-bbcd-085a79ac83e4 req-790a4c18-f32e-4157-a95d-0230b8e0effc service nova] Releasing lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-changed-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Refreshing instance network info cache due to event network-changed-d9f83989-3a77-4ca2-90bf-d6485e6999a9. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] Acquiring lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] Acquired lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG nova.network.neutron [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Refreshing network info cache for port d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lazy-loading 'flavor' on Instance uuid 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG nova.network.neutron [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updated VIF entry in instance network info cache for port d9f83989-3a77-4ca2-90bf-d6485e6999a9. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG nova.network.neutron [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updating instance_info_cache with network_info: [{"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1aad939e-32c0-4de2-99c6-acd121a0bfab req-c516464d-7892-42d4-94a1-bb824e175c50 service nova] Releasing lock "refresh_cache-72f841aa-13fb-4373-9225-2df8a700e045" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG nova.objects.instance [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lazy-loading 'flavor' on Instance uuid b44f50fc-d483-4a67-8fd1-7146a3d0adbd {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:56 user nova-compute[75203]: INFO nova.compute.manager [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Attaching volume 14236553-7e44-43c8-a297-c954abfedf00 to /dev/vdb
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.utils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f760ce-26da-4c9b-835d-ec83ef82a746]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c8d0b7-9566-49f5-877b-195ae015b0df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a0ab5-28ce-4e7e-abdb-59984be5bc83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e332010-cbde-4304-8768-0d838f6a6792]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:56 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[286a572a-c0ea-4e3d-97c6-419dcb764f02]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.utils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updating existing volume attachment record: be5eb267-e8f9-44df-8088-9ada08915fea {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:36:56 user nova-compute[75203]: INFO nova.compute.manager [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Attaching volume 754b73d8-ef2d-4065-b44d-447551767363 to /dev/vdb
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.utils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d9ed1-d2f1-4197-baed-b9220ab3b31a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[57caaa99-3514-4ba9-bc0c-baec0850b2f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[79316fd6-332a-43cf-ad69-d374f33ed386]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4134a3cf-dedc-4f85-930e-fa21518eee61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:36:56 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:36:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aeb241-ef74-42f4-8596-22c293bb5499]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG os_brick.utils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:36:56 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updating existing volume attachment record: 137527f1-c457-40ab-96ba-1d2f24e9b671 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:36:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:36:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdYxChUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:04 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:04 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:04 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[293478df-c777-48f2-9db7-bd74036cf551]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:37:04 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:04 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4e2416-cc4a-4e8f-9423-561f1ea33aea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363] added
Nov 28 18:37:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c978f09-3baf-4bba-a14a-12662e8fdbac]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e915424-c5ec-472c-b5d4-8bd03d3eb4a2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdYxChUf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdYxChUf" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f06aa23-b2bd-48c8-b985-40ecfc3dd8d0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mdYxChUf'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927aaf2-34c0-479a-b48f-244347dceb40]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef478fc3-774b-4c7d-bef7-ff5fdcf9a768]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2986c9c-1f4d-4bdb-aed5-47d74f5d857f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260]
Nov 28 18:37:04 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3ae5e-b92e-4327-bd67-9ee753029e8b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d9e433-f61c-427f-9ac5-9c6602a03dde]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2958b-adc1-4c73-b38e-ed21ad94a742]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:37:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdYxChUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26662386632666465', 'path': '/dev/sdf'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662386632666465', 'path': '/dev/sdf'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.285s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:05 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:05 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG nova.objects.instance [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lazy-loading 'flavor' on Instance uuid b44f50fc-d483-4a67-8fd1-7146a3d0adbd {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b451f93-b0f6-43c8-bc0b-88cfc91536e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:37:05 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:37:05 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:05 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:37:05 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:05 user nova-compute[75203]:   <serial>754b73d8-ef2d-4065-b44d-447551767363</serial>
Nov 28 18:37:05 user nova-compute[75203]: </disk>
Nov 28 18:37:05 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4738c4e0-f535-43b0-8f03-90c0f690875e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00] added
Nov 28 18:37:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9345ad05-d454-4b7b-9fc5-3cbd502b3f12]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682a4bb-c879-426a-aec2-4fd91bb5e4ae]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzJfgyIc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzJfgyIc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea998cd5-55dc-4ee1-84f0-66f359d7f404]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzJfgyIc'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2893544-e378-4c8f-8d65-22f6cf574618]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d57bd-c1f2-40d6-bcd7-cf91e722b842]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:05 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8be3a9-458f-47a5-ae0e-9bd824e6cc05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]
Nov 28 18:37:06 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a716850-304b-4408-91ad-272fab3740bd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e6682c-4912-4e40-92b7-ddd9ad3790be]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a3edf1-2d59-4a58-bcff-83b33c26cc14]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] No VIF found with MAC fa:16:3e:16:4d:14, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-570c4cb2-322b-40f4-84a4-42b2856aaa2d tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.015s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-changed-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Refreshing instance network info cache due to event network-changed-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] Acquiring lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] Acquired lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:37:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Refreshing network info cache for port e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lazy-loading 'flavor' on Instance uuid a233bb09-8c6e-44d0-945f-ee219a6e1bfa {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] <== connect_volume: return (2636ms) {'type': 'block', 'scsi_wwn': '23231316632626137', 'path': '/dev/sdg'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231316632626137', 'path': '/dev/sdg'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lazy-loading 'flavor' on Instance uuid 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:37:07 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:07 user nova-compute[75203]:   <source dev="/dev/sdg"/>
Nov 28 18:37:07 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:07 user nova-compute[75203]:   <serial>14236553-7e44-43c8-a297-c954abfedf00</serial>
Nov 28 18:37:07 user nova-compute[75203]: </disk>
Nov 28 18:37:07 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Updated VIF entry in instance network info cache for port e0c81299-ac22-4675-a91b-3e8ce5d9c9ef. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Updating instance_info_cache with network_info: [{"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:07 user nova-compute[75203]: INFO nova.compute.manager [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Attaching volume 557e5910-0d70-4ddc-bcc5-41812515c4f0 to /dev/vdb
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17bcf25a-2923-43c5-8d36-0b2f91a8aeeb req-bb6e38fd-ab5c-42ba-901a-394785820312 service nova] Releasing lock "refresh_cache-a233bb09-8c6e-44d0-945f-ee219a6e1bfa" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9275681-bc47-41ac-aecf-4c1383470f45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc501f20-d349-4b18-9eda-822304c8ab73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd54db8-962d-4f39-9b64-aedff479123d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0108bde3-feeb-432d-bf5f-cb65d409910b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:07 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d45768c-40b4-48cd-8922-6257fee05404]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Updating existing volume attachment record: 0954bde9-da85-44e6-a32a-c2186f5df424 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] No VIF found with MAC fa:16:3e:39:a4:8d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6f73416b-dd0c-4150-8e2e-74f42ddbf6c1 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.713s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:08 user nova-compute[75203]: INFO nova.compute.manager [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Detaching volume 754b73d8-ef2d-4065-b44d-447551767363
Nov 28 18:37:08 user nova-compute[75203]: INFO nova.virt.block_device [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Attempting to driver detach volume 754b73d8-ef2d-4065-b44d-447551767363 from mountpoint /dev/vdb
Nov 28 18:37:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Attempting to detach device vdb from instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:37:08 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:08 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:37:08 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:08 user nova-compute[75203]:   <serial>754b73d8-ef2d-4065-b44d-447551767363</serial>
Nov 28 18:37:08 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:37:08 user nova-compute[75203]: </disk>
Nov 28 18:37:08 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:37:08 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Successfully detached device vdb from instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd from the persistent domain config.
Nov 28 18:37:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:37:08 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:08 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:37:08 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:08 user nova-compute[75203]:   <serial>754b73d8-ef2d-4065-b44d-447551767363</serial>
Nov 28 18:37:08 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:37:08 user nova-compute[75203]: </disk>
Nov 28 18:37:08 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "72f841aa-13fb-4373-9225-2df8a700e045" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG os_brick.utils [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd12280-1b4e-40b3-9169-0de7a6433fab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b4eacb-5f71-4aee-a0fd-6c1b5d336e3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[92abb08a-9169-4cc8-bfaf-587e246531db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc00d07-8178-4b24-b929-2053db7f0d71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:08 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:37:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a6aab-8fc3-4b07-9063-3c667e705ee0]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG os_brick.utils [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:37:08 user nova-compute[75203]: INFO nova.compute.manager [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Swapping volume 14236553-7e44-43c8-a297-c954abfedf00 for 3547c4bf-7683-4a6c-bf85-20bc13c873e1
Nov 28 18:37:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-changed-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Refreshing instance network info cache due to event network-changed-547b5c17-1da6-4e8e-92fa-4edd0aabcdad. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:37:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] Acquiring lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:37:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] Acquired lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:37:14 user nova-compute[75203]: DEBUG nova.network.neutron [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Refreshing network info cache for port 547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:37:15 user nova-compute[75203]: DEBUG nova.network.neutron [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updated VIF entry in instance network info cache for port 547b5c17-1da6-4e8e-92fa-4edd0aabcdad. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:37:15 user nova-compute[75203]: DEBUG nova.network.neutron [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updating instance_info_cache with network_info: [{"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:37:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2bdd2c5f-0cfd-479d-be07-566880f29de6 req-164f4e50-9dba-4a8d-8030-cec0d3bd8d2f service nova] Releasing lock "refresh_cache-b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:37:15 user nova-compute[75203]: INFO nova.compute.manager [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Rebuilding instance
Nov 28 18:37:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:37:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfsdcyNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72f841aa-13fb-4373-9225-2df8a700e045', 'attached_at': '', 'detached_at': '', 'volume_id': '3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'serial': '3547c4bf-7683-4a6c-bf85-20bc13c873e1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '72f841aa-13fb-4373-9225-2df8a700e045', 'attached_at': '', 'detached_at': '', 'volume_id': '14236553-7e44-43c8-a297-c954abfedf00', 'serial'} {{(pid=75203) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfsdcyNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:16 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:16 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:16 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb2061a-379c-4319-910b-30efe91f9380]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:37:16 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adac0d9-5308-4a06-8a24-6ee8d73b31c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1] added
Nov 28 18:37:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-unplugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-unplugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:37:16 user nova-compute[75203]: WARNING nova.compute.manager [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received unexpected event network-vif-unplugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with vm_state active and task_state rebuilding.
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:37:16 user nova-compute[75203]: WARNING nova.compute.manager [req-3e66e1aa-bbde-41b6-b7be-a7f4938ce8b6 req-6d5309b6-2caf-4094-aa09-827d345bdee6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received unexpected event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with vm_state active and task_state rebuilding.
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffb5cdf-a86a-4082-b66d-2b12bd1f095a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance destroyed successfully.
Nov 28 18:37:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance destroyed successfully.
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-129040155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540435995',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6oL/7vvy9taX59bYI1WkM2HscWCZsFVsysC1exh/0Cmaz5gesQgSdKJwRW00bX89IFpRG0IkpITdH7sGiUa2XGjjHsEJIxVsYERrNHqSdOkmfTf8b+AU/z+Ywzde3ffQ==',key_name='tempest-keypair-1295110036',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='93335bb18c124da8b9eb12111d71ff4f',ramdisk_id='',reservation_id='r-1occtchr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647964474',owner_user_name='tempest-ServerActionsV293TestJSON-647964474-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc933353e4e643ea86c6dfb0337302b1',uuid=b8e8fdb2-f3a6-45dc-96d2-b9703922ef10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converting VIF {"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_vif [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8b968-ea44-47c6-aecd-41c395e4b545]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap547b5c17-1d, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfsdcyNF {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10659487-f20d-4bb7-87c7-e4051d73dae1) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:16 user nova-compute[75203]: INFO os_vif [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d')
Nov 28 18:37:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:16 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UfsdcyNF" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e78002-4508-4a3b-95c6-57e665df5c4e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UfsdcyNF'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed79e321-c4bb-4b34-bbd7-9900489de3b6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b027945-50f3-4149-9503-61f5fee52eff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54466d0-30f5-49cf-ac90-0f2d8624eace]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260]
Nov 28 18:37:16 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e244831-6e20-4737-898f-8d42893d14d5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7d16f0-bd45-4f8a-86e9-89b3a12c6cc6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6f689-d8ee-40e0-b5ac-2f467154bf8e]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:37:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfsdcyNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26162343638616566', 'path': '/dev/sdh'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162343638616566', 'path': '/dev/sdh'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.283s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lazy-loading 'flavor' on Instance uuid 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae8ef8-9ade-4f6e-b265-41cc6d913d2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:37:17 user nova-compute[75203]: No targets found.
Nov 28 18:37:17 user nova-compute[75203]: iSNS:
Nov 28 18:37:17 user nova-compute[75203]: No targets found.
Nov 28 18:37:17 user nova-compute[75203]: STATIC:
Nov 28 18:37:17 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:37:17 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:17 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:17 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363
Nov 28 18:37:17 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:17 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:17 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8
Nov 28 18:37:17 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:17 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:17 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:37:17 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:17 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:17 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1
Nov 28 18:37:17 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:17 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:17 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:37:17 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:17 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:17 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:37:17 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:17 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:17 user nova-compute[75203]: FIRMWARE:
Nov 28 18:37:17 user nova-compute[75203]: No targets found.
Nov 28 18:37:17 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:37:17 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:37:17 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd86c7-5d18-4d9e-bf05-85ea8913fd05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581db75-ae1c-4886-a583-8db057eacc91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:17 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a025a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58f9d4f-21da-4a33-80ec-50ae0b9c5075]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82eb367-425b-4b6d-98f5-1d45e96ae472]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7851e-efb3-43cd-90e6-af7febc52323]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea562be-ec9a-4c3c-a2f4-da17ececbebb]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfSbcuOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:18 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aa020d-d461-41db-ad50-c8cc85038dd9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fe43f5-421e-418b-9430-a0e53436a332]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]
Nov 28 18:37:18 user nova-compute[75203]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d500809-14dc-498a-80ae-e75c0f6298b1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] <== disconnect_volume: return (1638ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:37:18 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Deleting instance files /opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10_del
Nov 28 18:37:18 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Deletion of /opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10_del complete
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.129s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:18 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:18 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bcbe96-7b0d-478c-a0da-9069ce6a37ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:37:18 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[92475022-ca83-4084-ae1a-b87d6a1be866]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0] added
Nov 28 18:37:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c552efbc-95b5-443a-863e-38a7a91200a4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a65cd-f18e-4886-b5d9-9d3af0e646f3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfSbcuOH {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfSbcuOH" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8770be55-8f9b-40cf-8448-ab37e1d997fc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfSbcuOH'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8519152-568c-445f-b2f7-1f401721c9aa]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da8aa42-5872-4b9f-96c0-4443b26e9634]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 could not be found.
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[842ad7bf-bff8-45ef-910b-0b3f3a864865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260]
Nov 28 18:37:18 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:18 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[85881dac-b903-4451-a1d0-510fb897b716]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc26efc-275f-48d3-85ac-ea8692119a71]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4f742-26c6-4f73-a674-30ce3789d53c]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfSbcuOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:37:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] <== connect_volume: return (1606ms) {'type': 'block', 'scsi_wwn': '23061313565653461', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061313565653461', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.139s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lazy-loading 'flavor' on Instance uuid a233bb09-8c6e-44d0-945f-ee219a6e1bfa {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa70e5a2-5faf-4e87-b315-379ad516c36d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:37:19 user nova-compute[75203]: No targets found.
Nov 28 18:37:19 user nova-compute[75203]: iSNS:
Nov 28 18:37:19 user nova-compute[75203]: No targets found.
Nov 28 18:37:19 user nova-compute[75203]: STATIC:
Nov 28 18:37:19 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:37:19 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:19 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:19 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363
Nov 28 18:37:19 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:19 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:19 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:37:19 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:19 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:19 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1
Nov 28 18:37:19 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:19 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:19 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:37:19 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:19 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:19 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0
Nov 28 18:37:19 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:19 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:19 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:37:19 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:19 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:19 user nova-compute[75203]: FIRMWARE:
Nov 28 18:37:19 user nova-compute[75203]: No targets found.
Nov 28 18:37:19 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:37:19 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:37:19 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] attach device xml: <disk type="block" device="disk">
Nov 28 18:37:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:19 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:37:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:19 user nova-compute[75203]:   <serial>557e5910-0d70-4ddc-bcc5-41812515c4f0</serial>
Nov 28 18:37:19 user nova-compute[75203]: </disk>
Nov 28 18:37:19 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a768e2d-25bd-4dfc-a424-b4b1ac86f25e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[412290d2-5aad-4103-860c-cc1dfcc78c21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:19 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a025a5f0>, {}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Disconnecting from: [] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.110s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] <== disconnect_volume: return (1249ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:37:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 460324864 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] No VIF found with MAC fa:16:3e:8d:68:9d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:37:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 615514112 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1da3837f-851c-4fa2-bcad-fc8c20ebf89f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.239s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 781189120 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 945815552 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] volume_snapshot_create: create_info: {'snapshot_id': '914369e3-d9fa-40a6-bd50-a2905d4ffd8d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75203) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 28 18:37:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] snap xml: <domainsnapshot>
Nov 28 18:37:21 user nova-compute[75203]:   <disks>
Nov 28 18:37:21 user nova-compute[75203]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 28 18:37:21 user nova-compute[75203]:       <source file="/dev/new_file"/>
Nov 28 18:37:21 user nova-compute[75203]:     </disk>
Nov 28 18:37:21 user nova-compute[75203]:     <disk name="vda" snapshot="no"/>
Nov 28 18:37:21 user nova-compute[75203]:   </disks>
Nov 28 18:37:21 user nova-compute[75203]: </domainsnapshot>
Nov 28 18:37:21 user nova-compute[75203]:  {{(pid=75203) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 28 18:37:21 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] Lazy-loading 'system_metadata' on Instance uuid a233bb09-8c6e-44d0-945f-ee219a6e1bfa {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-517a5064-f48a-48be-a1f5-697f9b59024b tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] volume_snapshot_delete: delete_info: {'volume_id': '557e5910-0d70-4ddc-bcc5-41812515c4f0'} {{(pid=75203) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [None req-517a5064-f48a-48be-a1f5-697f9b59024b tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     if delete_info['type'] != 'qcow2':
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] KeyError: 'type'
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] 
Nov 28 18:37:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     rv = execute(f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     six.reraise(c, e, tb)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     raise value
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     rv = meth(*args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     self._volume_snapshot_create(context, instance, guest,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     rv = execute(f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     six.reraise(c, e, tb)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     raise value
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     rv = meth(*args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [None req-517a5064-f48a-48be-a1f5-697f9b59024b tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9f4f0507-814d-4e41-a3f8-4b8987c3a42a)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server [None req-517a5064-f48a-48be-a1f5-697f9b59024b tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] Exception during message handling: KeyError: 'type'
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 914369e3-d9fa-40a6-bd50-a2905d4ffd8d could not be found.
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise value
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 914369e3-d9fa-40a6-bd50-a2905d4ffd8d could not be found. (HTTP 404) (Request-ID: req-dce92504-072b-452e-8825-7532deabb135)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 914369e3-d9fa-40a6-bd50-a2905d4ffd8d could not be found.
Nov 28 18:37:21 user nova-compute[75203]: ERROR nova.virt.libvirt.driver 
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server [None req-f8d16e48-4e05-434b-b590-bc2134c63798 tempest-VolumesAssistedSnapshotsTest-1460362279 tempest-VolumesAssistedSnapshotsTest-1460362279-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise value
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 28 18:37:21 user nova-compute[75203]: ERROR oslo_messaging.rpc.server 
Nov 28 18:37:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 1072693248 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:22 user nova-compute[75203]: INFO nova.compute.manager [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Detaching volume 557e5910-0d70-4ddc-bcc5-41812515c4f0
Nov 28 18:37:22 user nova-compute[75203]: INFO nova.virt.block_device [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Attempting to driver detach volume 557e5910-0d70-4ddc-bcc5-41812515c4f0 from mountpoint /dev/vdb
Nov 28 18:37:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Attempting to detach device vdb from instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 18:37:22 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:22 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:37:22 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:22 user nova-compute[75203]:   <serial>557e5910-0d70-4ddc-bcc5-41812515c4f0</serial>
Nov 28 18:37:22 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:37:22 user nova-compute[75203]: </disk>
Nov 28 18:37:22 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:37:22 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Successfully detached device vdb from instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa from the persistent domain config.
Nov 28 18:37:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] detach device xml: <disk type="block" device="disk">
Nov 28 18:37:22 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:22 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:37:22 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:22 user nova-compute[75203]:   <serial>557e5910-0d70-4ddc-bcc5-41812515c4f0</serial>
Nov 28 18:37:22 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:37:22 user nova-compute[75203]: </disk>
Nov 28 18:37:22 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:22 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[724b0505-b5e0-4b37-b5ab-8acbd3741f02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:37:22 user nova-compute[75203]: No targets found.
Nov 28 18:37:22 user nova-compute[75203]: iSNS:
Nov 28 18:37:22 user nova-compute[75203]: No targets found.
Nov 28 18:37:22 user nova-compute[75203]: STATIC:
Nov 28 18:37:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:37:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363
Nov 28 18:37:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:37:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1
Nov 28 18:37:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:37:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0
Nov 28 18:37:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:37:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:22 user nova-compute[75203]: FIRMWARE:
Nov 28 18:37:22 user nova-compute[75203]: No targets found.
Nov 28 18:37:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:37:22 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:37:22 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29b952f-8524-44a5-bb29-2470a83a283e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff5dc43-e83a-4267-94da-2c04a61e1c06]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a0258700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00'): ({'sdg'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Removing single pathed devices sdg {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3704630c-7c75-40b9-aee7-5c0653c550d3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf0009-03ea-436c-b97b-ccc2d764d2a8]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Flushing IO for device /dev/sdg {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f3198-e2f2-4cef-a8e2-1ba3d3986ab2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e63919c-704e-40d8-9de0-f08840b5134e]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] SCSI volumes sdg have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:37:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada9f0e6-44c0-401d-b404-7b22b1190069]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a3684-ae6a-4df6-8e34-2b77aaf458cd]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]
Nov 28 18:37:23 user nova-compute[75203]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b24c03b-1fd1-4dca-8dee-28efc431f194]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] <== disconnect_volume: return (333ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfsdcyNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '72f841aa-13fb-4373-9225-2df8a700e045', 'attached_at': '', 'detached_at': '', 'volume_id': '3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'serial'} {{(pid=75203) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] swap_volume: removing Cinder connection for volume 14236553-7e44-43c8-a297-c954abfedf00 {{(pid=75203) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Preparing to wait for external event volume-reimaged-ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 {{(pid=75203) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] swap_volume: Updating volume 14236553-7e44-43c8-a297-c954abfedf00 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UfsdcyNF", "auth_password": "WMAeXhunkO6QYJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "3547c4bf-7683-4a6c-bf85-20bc13c873e1"}, "status": "reserved", "instance": "72f841aa-13fb-4373-9225-2df8a700e045", "attached_at": "", "detached_at": "", "volume_id": "3547c4bf-7683-4a6c-bf85-20bc13c873e1", "serial": "3547c4bf-7683-4a6c-bf85-20bc13c873e1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'no_device': None, 'attachment_id': 'f529890f-660e-4c10-8602-8ad6307ccd66'} {{(pid=75203) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 18:37:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d2ad8900-6967-4e01-aef5-a247d8224bc5 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "72f841aa-13fb-4373-9225-2df8a700e045" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.506s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "72f841aa-13fb-4373-9225-2df8a700e045" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG os_brick.utils [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a80049-b873-4e05-a921-41fde05b75e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbda487-c77d-4668-b079-4a4b130c30ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f3d91-4269-4c34-a4e7-18efe3e21868]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb1f85-2446-40b8-acd1-4726b6d950d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:25 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:37:25 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6b9ab0-79b8-420f-b633-6864e59c4429]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:37:25 user nova-compute[75203]: DEBUG os_brick.utils [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:25 user nova-compute[75203]: INFO nova.compute.manager [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Swapping volume 3547c4bf-7683-4a6c-bf85-20bc13c873e1 for 14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:37:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd is timed out.
Nov 28 18:37:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Successfully detached device vdb from instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd from the live domain config.
Nov 28 18:37:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdYxChUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:28 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f868ae9-7562-411b-b866-efe4bf06ef73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:37:28 user nova-compute[75203]: No targets found.
Nov 28 18:37:28 user nova-compute[75203]: iSNS:
Nov 28 18:37:28 user nova-compute[75203]: No targets found.
Nov 28 18:37:28 user nova-compute[75203]: STATIC:
Nov 28 18:37:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:37:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363
Nov 28 18:37:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:37:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1
Nov 28 18:37:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:37:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0
Nov 28 18:37:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:28 user nova-compute[75203]: FIRMWARE:
Nov 28 18:37:28 user nova-compute[75203]: No targets found.
Nov 28 18:37:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:37:28 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:37:28 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d4170-f8a3-4a91-b565-bfcf0ff43be7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[52353fdd-c9c1-4e09-9927-e101b65fbf8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a0337130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363'): ({'sdf'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Removing single pathed devices sdf {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbba7f1-f88f-4682-b03f-f90df2cd12ab]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[62755f90-f1ea-4884-b64a-a53e0670a1ee]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Flushing IO for device /dev/sdf {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb4e84-5f39-43df-8ba3-630b107c4ecb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:37:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9741741-7cb7-49fb-ac93-e1a23cdf7108]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63880ae-48b8-47cb-8cfd-bf586191c6b0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --logout" returned: 0 in 0.180s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6109f9-1c31-4aec-b03b-e8f5a1e9f404]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260]
Nov 28 18:37:29 user nova-compute[75203]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:29 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:754b73d8-ef2d-4065-b44d-447551767363 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0afa5af-30fe-4913-896e-40a5d8f3d420]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] <== disconnect_volume: return (498ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:37:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:37:34 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lazy-loading 'flavor' on Instance uuid b44f50fc-d483-4a67-8fd1-7146a3d0adbd {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4852aee9-3282-4bce-89bd-3cbb69683a18 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.823s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72f841aa-13fb-4373-9225-2df8a700e045', 'attached_at': '', 'detached_at': '', 'volume_id': '14236553-7e44-43c8-a297-c954abfedf00', 'serial': '14236553-7e44-43c8-a297-c954abfedf00'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfsdcyNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '3547c4bf-7683-4a6c-bf85-20bc13c873e1'}, 'status': 'reserved', 'instance': '72f841aa-13fb-4373-9225-2df8a700e045', 'attached_at': '', 'detached_at': '', 'volume_id': '3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'serial'} {{(pid=75203) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:35 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:35 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:35 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5477a774-a2a2-4810-a4e4-98f208b435f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:37:35 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba912f2-712d-4847-9f4f-0d6aa12be958]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00] added
Nov 28 18:37:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea6b968-2237-4efe-82fe-493dd082701b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e126548-56df-45fb-a780-b1fd3cddecce]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzJfgyIc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hzJfgyIc" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[23609b68-55f9-4416-9e9b-12d2bab3f7cc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hzJfgyIc'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f7d41b-7f72-4224-a842-bb5b11b4bd8c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2e9e3-1fd5-4cdb-b20c-1d9705056e07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05e0ebd-50f4-4e35-8907-1641c15b2499]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]
Nov 28 18:37:35 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2c3df4-70bd-455a-b1a5-6d42c551478e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c804f3f3-8769-4e41-9bc9-47d892915d74]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa97c42-feb1-488b-84ec-3b53458c0e7d]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:37:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23231316632626137', 'path': '/dev/sdg'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231316632626137', 'path': '/dev/sdg'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:37:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lazy-loading 'flavor' on Instance uuid 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 73400320 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:37:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 170917888 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 235929600 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 288358400 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 297795584 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:37:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 427819008 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "6663b95e-c45f-4ffc-abba-ca678dbd898e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:41 user nova-compute[75203]: INFO nova.compute.manager [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Terminating instance
Nov 28 18:37:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5515de9-e2d4-422c-9088-00c5a5e7f657 req-ad43f9df-7c8c-47d2-a328-62fef261837a service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received event network-vif-unplugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5515de9-e2d4-422c-9088-00c5a5e7f657 req-ad43f9df-7c8c-47d2-a328-62fef261837a service nova] Acquiring lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5515de9-e2d4-422c-9088-00c5a5e7f657 req-ad43f9df-7c8c-47d2-a328-62fef261837a service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5515de9-e2d4-422c-9088-00c5a5e7f657 req-ad43f9df-7c8c-47d2-a328-62fef261837a service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5515de9-e2d4-422c-9088-00c5a5e7f657 req-ad43f9df-7c8c-47d2-a328-62fef261837a service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] No waiting events found dispatching network-vif-unplugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5515de9-e2d4-422c-9088-00c5a5e7f657 req-ad43f9df-7c8c-47d2-a328-62fef261837a service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received event network-vif-unplugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 732954624 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Instance destroyed successfully.
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lazy-loading 'resources' on Instance uuid 6663b95e-c45f-4ffc-abba-ca678dbd898e {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:42 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa is timed out.
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1723863283',display_name='tempest-VolumesActionsTest-instance-1723863283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1723863283',id=10,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94d831ddd234468f876de2b487471f02',ramdisk_id='',reservation_id='r-l0j8q4em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-15073388',owner_user_name='tempest-VolumesActionsTest-15073388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:35:53Z,user_data=None,user_id='678261cef73e4dcabd85b927b45aeb97',uuid=6663b95e-c45f-4ffc-abba-ca678dbd898e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Converting VIF {"id": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "address": "fa:16:3e:9e:34:1b", "network": {"id": "416b7082-90b8-4b86-bbbd-4668b284f4e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-491125186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94d831ddd234468f876de2b487471f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa743ed4c-f5", "ovs_interfaceid": "a743ed4c-f580-4b0d-99ee-0700df5d5d92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:1b,bridge_name='br-int',has_traffic_filtering=True,id=a743ed4c-f580-4b0d-99ee-0700df5d5d92,network=Network(416b7082-90b8-4b86-bbbd-4668b284f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa743ed4c-f5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG os_vif [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:1b,bridge_name='br-int',has_traffic_filtering=True,id=a743ed4c-f580-4b0d-99ee-0700df5d5d92,network=Network(416b7082-90b8-4b86-bbbd-4668b284f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa743ed4c-f5') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:37:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Successfully detached device vdb from instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa from the live domain config.
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa743ed4c-f5, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1f978a1-21d3-4379-9b07-5a827e545da2) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfSbcuOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:42 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 822083584 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c2954-acc3-4a09-9c06-ef819af6e684]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:37:42 user nova-compute[75203]: No targets found.
Nov 28 18:37:42 user nova-compute[75203]: iSNS:
Nov 28 18:37:42 user nova-compute[75203]: No targets found.
Nov 28 18:37:42 user nova-compute[75203]: STATIC:
Nov 28 18:37:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:37:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:37:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1
Nov 28 18:37:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:37:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0
Nov 28 18:37:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:37:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:42 user nova-compute[75203]: FIRMWARE:
Nov 28 18:37:42 user nova-compute[75203]: No targets found.
Nov 28 18:37:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:37:42 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:37:42 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef31d67-0c68-4b98-a8e5-28baadbf45e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: INFO os_vif [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:1b,bridge_name='br-int',has_traffic_filtering=True,id=a743ed4c-f580-4b0d-99ee-0700df5d5d92,network=Network(416b7082-90b8-4b86-bbbd-4668b284f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa743ed4c-f5')
Nov 28 18:37:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Deleting instance files /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e_del
Nov 28 18:37:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Deletion of /opt/stack/data/nova/instances/6663b95e-c45f-4ffc-abba-ca678dbd898e_del complete
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 1019215872 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:43 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:37:43 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7331MB free_disk=25.333648681640625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e49b9-9a08-463a-8fc9-d7fe20d5519b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a856f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: INFO nova.compute.manager [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Took 1.97 seconds to destroy the instance on the hypervisor.
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e6224e-bf06-4071-8f9f-e55e7b9a63ef]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded9d3dd-990b-41bf-bd87-71ff027759a9]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98cb23c-62b2-45b0-b21c-d4354608bd25]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 72f841aa-13fb-4373-9225-2df8a700e045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 6663b95e-c45f-4ffc-abba-ca678dbd898e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 16c72606-ed4c-4c7a-8295-a76da36da957 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance eec19476-5b8e-4d91-b0e3-6ecd0986632d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea02be5-af2b-427a-a9cf-523531fd813d]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c50b04-0c43-4181-89f8-2c8e7b61ac39]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf21f2-be30-4ec7-9417-62d2553dc0e7]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260]
Nov 28 18:37:43 user nova-compute[75203]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:557e5910-0d70-4ddc-bcc5-41812515c4f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c6996-a4a1-41e7-a4b7-61ae467c8ec2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.105s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] <== disconnect_volume: return (1107ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UfsdcyNF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '3547c4bf-7683-4a6c-bf85-20bc13c873e1'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:44 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-d3d56bdb-d1b8-4e6a-a6c6-0c613df0bb6b req-00cf2947-1ed8-4ee3-b975-b4ac0e7b7af9 service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received event network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d3d56bdb-d1b8-4e6a-a6c6-0c613df0bb6b req-00cf2947-1ed8-4ee3-b975-b4ac0e7b7af9 service nova] Acquiring lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d3d56bdb-d1b8-4e6a-a6c6-0c613df0bb6b req-00cf2947-1ed8-4ee3-b975-b4ac0e7b7af9 service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d3d56bdb-d1b8-4e6a-a6c6-0c613df0bb6b req-00cf2947-1ed8-4ee3-b975-b4ac0e7b7af9 service nova] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-d3d56bdb-d1b8-4e6a-a6c6-0c613df0bb6b req-00cf2947-1ed8-4ee3-b975-b4ac0e7b7af9 service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] No waiting events found dispatching network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:37:44 user nova-compute[75203]: WARNING nova.compute.manager [req-d3d56bdb-d1b8-4e6a-a6c6-0c613df0bb6b req-00cf2947-1ed8-4ee3-b975-b4ac0e7b7af9 service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received unexpected event network-vif-plugged-a743ed4c-f580-4b0d-99ee-0700df5d5d92 for instance with vm_state active and task_state deleting.
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea581f8-47df-4f95-8c6c-37ff941ea792]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:37:44 user nova-compute[75203]: No targets found.
Nov 28 18:37:44 user nova-compute[75203]: iSNS:
Nov 28 18:37:44 user nova-compute[75203]: No targets found.
Nov 28 18:37:44 user nova-compute[75203]: STATIC:
Nov 28 18:37:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:37:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:37:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1
Nov 28 18:37:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:37:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:37:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:37:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:37:44 user nova-compute[75203]: FIRMWARE:
Nov 28 18:37:44 user nova-compute[75203]: No targets found.
Nov 28 18:37:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:37:44 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:37:44 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d87e3d-35ce-49d3-85f9-a776c828892e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Took 0.80 seconds to deallocate network for instance.
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e083ff8-feb6-4efd-878a-12cdc40ae46f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:44 user nova-compute[75203]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 (non-flash)
Nov 28 18:37:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790454ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1'): ({'sdh'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Removing single pathed devices sdh {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da1e0e8-edf1-4752-8b18-f4c3b656e797]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27fa23-81c5-43c5-ae9d-d46378e8aae4]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Flushing IO for device /dev/sdh {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa04ffa-4c13-4ee7-9943-c56a7e4f6309]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5862833-32ec-4f1d-854e-b85627a3d7b0]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] SCSI volumes sdh have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3116a2cb-4346-40d1-823d-1ecf3e1d8477]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[31231de2-271e-49fd-b895-27b7fff6a072]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260]
Nov 28 18:37:44 user nova-compute[75203]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3547c4bf-7683-4a6c-bf85-20bc13c873e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9d3db0-cad4-448b-b413-3f0c682147cb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] <== disconnect_volume: return (408ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '72f841aa-13fb-4373-9225-2df8a700e045', 'attached_at': '', 'detached_at': '', 'volume_id': '14236553-7e44-43c8-a297-c954abfedf00', 'serial'} {{(pid=75203) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] swap_volume: removing Cinder connection for volume 3547c4bf-7683-4a6c-bf85-20bc13c873e1 {{(pid=75203) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG nova.objects.instance [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lazy-loading 'flavor' on Instance uuid a233bb09-8c6e-44d0-945f-ee219a6e1bfa {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:44 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Deleted allocations for instance 6663b95e-c45f-4ffc-abba-ca678dbd898e
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-808f4ac3-25a8-436c-8ea7-b64ede84f55f tempest-VolumesAssistedSnapshotsTest-919564340 tempest-VolumesAssistedSnapshotsTest-919564340-project-admin] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.721s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a51b559-92af-44d1-a419-af76942cd197 tempest-VolumesActionsTest-15073388 tempest-VolumesActionsTest-15073388-project-member] Lock "6663b95e-c45f-4ffc-abba-ca678dbd898e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.314s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] swap_volume: Updating volume 3547c4bf-7683-4a6c-bf85-20bc13c873e1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "hzJfgyIc", "auth_password": "3zTindE7VeUIOF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "14236553-7e44-43c8-a297-c954abfedf00"}, "status": "reserved", "instance": "72f841aa-13fb-4373-9225-2df8a700e045", "attached_at": "", "detached_at": "", "volume_id": "14236553-7e44-43c8-a297-c954abfedf00", "serial": "14236553-7e44-43c8-a297-c954abfedf00"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '14236553-7e44-43c8-a297-c954abfedf00', 'no_device': None, 'attachment_id': '81d294dd-0399-4cc1-92e9-ee775a667be5'} {{(pid=75203) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 28 18:37:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b8abb04f-2171-4236-998f-0abc37ca7aa7 tempest-TestVolumeSwap-943072810 tempest-TestVolumeSwap-943072810-project-admin] Lock "72f841aa-13fb-4373-9225-2df8a700e045" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.149s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:46 user nova-compute[75203]: INFO nova.compute.manager [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Detaching volume 14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:37:46 user nova-compute[75203]: INFO nova.virt.block_device [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Attempting to driver detach volume 14236553-7e44-43c8-a297-c954abfedf00 from mountpoint /dev/vdb
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Attempting to detach device vdb from instance 72f841aa-13fb-4373-9225-2df8a700e045 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:37:46 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:46 user nova-compute[75203]:   <source dev="/dev/sdg"/>
Nov 28 18:37:46 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:46 user nova-compute[75203]:   <serial>14236553-7e44-43c8-a297-c954abfedf00</serial>
Nov 28 18:37:46 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:37:46 user nova-compute[75203]: </disk>
Nov 28 18:37:46 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:37:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Successfully detached device vdb from instance 72f841aa-13fb-4373-9225-2df8a700e045 from the persistent domain config.
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72f841aa-13fb-4373-9225-2df8a700e045 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:37:46 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:46 user nova-compute[75203]:   <source dev="/dev/sdg"/>
Nov 28 18:37:46 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:46 user nova-compute[75203]:   <serial>14236553-7e44-43c8-a297-c954abfedf00</serial>
Nov 28 18:37:46 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:37:46 user nova-compute[75203]: </disk>
Nov 28 18:37:46 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 req-26d6261e-ac36-4c83-8a70-bed67bc93eb5 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event volume-reimaged-ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 req-26d6261e-ac36-4c83-8a70-bed67bc93eb5 service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 req-26d6261e-ac36-4c83-8a70-bed67bc93eb5 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 req-26d6261e-ac36-4c83-8a70-bed67bc93eb5 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 req-26d6261e-ac36-4c83-8a70-bed67bc93eb5 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Processing event volume-reimaged-ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-1a1208c2-f740-4f05-a474-a80c306de201 req-48795e66-b9ae-424a-9216-29d2b378e412 service nova] [instance: 6663b95e-c45f-4ffc-abba-ca678dbd898e] Received event network-vif-deleted-a743ed4c-f580-4b0d-99ee-0700df5d5d92 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:46 user nova-compute[75203]: INFO nova.virt.block_device [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Booting with volume ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 at /dev/vda
Nov 28 18:37:46 user nova-compute[75203]: DEBUG os_brick.utils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf92471-522e-47a3-bf90-c0b7a3a529ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a82d3d-f6b4-4862-9c8f-7f1c995cd3b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c356005-8c02-42b7-9a21-6e4437ebb1b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[315e5d8f-2001-4e77-b0e8-0984e56d824e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:46 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[79506c76-4c34-4a85-9350-d0a32a813479]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG os_brick.utils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updating existing volume attachment record: 9bc8d874-ee67-4be1-b36b-ab8ef8ef97b5 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-changed-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Refreshing instance network info cache due to event network-changed-80e627df-b79d-48cd-8445-3ca7c1cc7eeb. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] Acquiring lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] Acquired lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.network.neutron [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Refreshing network info cache for port 80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:37:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updating instance_info_cache with network_info: [{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG nova.network.neutron [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updated VIF entry in instance network info cache for port 80e627df-b79d-48cd-8445-3ca7c1cc7eeb. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG nova.network.neutron [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updating instance_info_cache with network_info: [{"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:37:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6493f440-e331-41bd-8346-eb3d64d88535 req-6affd006-e0a6-44ea-a357-c60ac5e3cd07 service nova] Releasing lock "refresh_cache-eec19476-5b8e-4d91-b0e3-6ecd0986632d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG nova.objects.instance [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lazy-loading 'flavor' on Instance uuid eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:48 user nova-compute[75203]: INFO nova.compute.manager [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Attaching volume 279129b2-2b52-490d-9664-6c6ea206321d to /dev/vdb
Nov 28 18:37:48 user nova-compute[75203]: DEBUG os_brick.utils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4487c-fadd-433f-838d-fefa768f6fe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede4315e-5c5c-41de-84b1-909f78603232]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e6aaa3-9537-47eb-9472-bb55a2e1ce9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b0180a-890c-49be-b37d-76ae552f5e72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:37:48 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:37:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[42094583-56dd-4602-ba64-29e2696353e5]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG os_brick.utils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updating existing volume attachment record: bb44f262-cdaf-4f28-8c4f-1af663c53c10 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:37:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:37:54 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Creating image(s)
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Ensure instance console log exists: /opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Start _get_guest_xml network_info=[{"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8e8fdb2-f3a6-45dc-96d2-b9703922ef10', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'serial': 'ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '9bc8d874-ee67-4be1-b36b-ab8ef8ef97b5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:37:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 18:37:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.objects.instance [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:54 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f051b-db33-418e-ad77-e513afceece6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:37:54 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdafa87-9d3a-41e9-be2a-99d0e1f8e7b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8] added
Nov 28 18:37:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d004d-f85f-4af6-ad11-c9a15b3d2c37]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2253aa7-ff7c-4672-89b3-a35c02db258c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbWXnoiw {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbWXnoiw" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e7b25d-b797-4ccf-9395-877fb414c6b3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tbWXnoiw'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa632ac-a100-4e0e-8848-a5dcb3aa037e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[719fc69a-1faa-4286-8114-d59c04f87093]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:54 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:54 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:54 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:54 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:54 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:54 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5998ffe4-f0fe-42c6-8e06-406cfc7fda39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]
Nov 28 18:37:54 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e328f9-ef80-46fd-afe8-e472d57af014]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[45473b3b-1313-4b6d-b32a-f7b652eda7bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:55 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[380085a5-45b0-4e70-baa2-798d0c2c441d]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:37:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23637373137303033', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373137303033', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhlceikj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:37:56 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:56 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:37:56 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-129040155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540435995',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6oL/7vvy9taX59bYI1WkM2HscWCZsFVsysC1exh/0Cmaz5gesQgSdKJwRW00bX89IFpRG0IkpITdH7sGiUa2XGjjHsEJIxVsYERrNHqSdOkmfTf8b+AU/z+Ywzde3ffQ==',key_name='tempest-keypair-1295110036',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='93335bb18c124da8b9eb12111d71ff4f',ramdisk_id='',reservation_id='r-1occtchr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647964474',owner_user_name='tempest-ServerActionsV293TestJSON-647964474-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc933353e4e643ea86c6dfb0337302b1',uuid=b8e8fdb2-f3a6-45dc-96d2-b9703922ef10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converting VIF {"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:37:56 user nova-compute[75203]:   <uuid>b8e8fdb2-f3a6-45dc-96d2-b9703922ef10</uuid>
Nov 28 18:37:56 user nova-compute[75203]:   <name>instance-00000009</name>
Nov 28 18:37:56 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:37:56 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:37:56 user nova-compute[75203]:   <metadata>
Nov 28 18:37:56 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:37:56 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:37:56 user nova-compute[75203]:       <nova:name>tempest-ServerActionsV293TestJSON-server-129040155</nova:name>
Nov 28 18:37:56 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:37:54</nova:creationTime>
Nov 28 18:37:56 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:37:56 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:37:56 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:37:56 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:37:56 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:37:56 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:37:56 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:37:56 user nova-compute[75203]:       <nova:owner>
Nov 28 18:37:56 user nova-compute[75203]:         <nova:user uuid="fc933353e4e643ea86c6dfb0337302b1">tempest-ServerActionsV293TestJSON-647964474-project-member</nova:user>
Nov 28 18:37:56 user nova-compute[75203]:         <nova:project uuid="93335bb18c124da8b9eb12111d71ff4f">tempest-ServerActionsV293TestJSON-647964474</nova:project>
Nov 28 18:37:56 user nova-compute[75203]:       </nova:owner>
Nov 28 18:37:56 user nova-compute[75203]:       <nova:ports>
Nov 28 18:37:56 user nova-compute[75203]:         <nova:port uuid="547b5c17-1da6-4e8e-92fa-4edd0aabcdad">
Nov 28 18:37:56 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:37:56 user nova-compute[75203]:         </nova:port>
Nov 28 18:37:56 user nova-compute[75203]:       </nova:ports>
Nov 28 18:37:56 user nova-compute[75203]:     </nova:instance>
Nov 28 18:37:56 user nova-compute[75203]:   </metadata>
Nov 28 18:37:56 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:37:56 user nova-compute[75203]:     <system>
Nov 28 18:37:56 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:37:56 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:37:56 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:37:56 user nova-compute[75203]:       <entry name="serial">b8e8fdb2-f3a6-45dc-96d2-b9703922ef10</entry>
Nov 28 18:37:56 user nova-compute[75203]:       <entry name="uuid">b8e8fdb2-f3a6-45dc-96d2-b9703922ef10</entry>
Nov 28 18:37:56 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:37:56 user nova-compute[75203]:     </system>
Nov 28 18:37:56 user nova-compute[75203]:   </sysinfo>
Nov 28 18:37:56 user nova-compute[75203]:   <os>
Nov 28 18:37:56 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:37:56 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:37:56 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:37:56 user nova-compute[75203]:   </os>
Nov 28 18:37:56 user nova-compute[75203]:   <features>
Nov 28 18:37:56 user nova-compute[75203]:     <acpi/>
Nov 28 18:37:56 user nova-compute[75203]:     <apic/>
Nov 28 18:37:56 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:37:56 user nova-compute[75203]:   </features>
Nov 28 18:37:56 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:37:56 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:37:56 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:37:56 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:37:56 user nova-compute[75203]:   </clock>
Nov 28 18:37:56 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:37:56 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:37:56 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:37:56 user nova-compute[75203]:   </cpu>
Nov 28 18:37:56 user nova-compute[75203]:   <devices>
Nov 28 18:37:56 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:37:56 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:56 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 18:37:56 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:37:56 user nova-compute[75203]:       <serial>ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8</serial>
Nov 28 18:37:56 user nova-compute[75203]:     </disk>
Nov 28 18:37:56 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:37:56 user nova-compute[75203]:       <mac address="fa:16:3e:73:e0:37"/>
Nov 28 18:37:56 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:37:56 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:37:56 user nova-compute[75203]:       <target dev="tap547b5c17-1d"/>
Nov 28 18:37:56 user nova-compute[75203]:     </interface>
Nov 28 18:37:56 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:37:56 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10/console.log" append="off"/>
Nov 28 18:37:56 user nova-compute[75203]:     </serial>
Nov 28 18:37:56 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:37:56 user nova-compute[75203]:     <video>
Nov 28 18:37:56 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:37:56 user nova-compute[75203]:     </video>
Nov 28 18:37:56 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:37:56 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:37:56 user nova-compute[75203]:     </rng>
Nov 28 18:37:56 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:37:56 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:37:56 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:37:56 user nova-compute[75203]:     </memballoon>
Nov 28 18:37:56 user nova-compute[75203]:   </devices>
Nov 28 18:37:56 user nova-compute[75203]: </domain>
Nov 28 18:37:56 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-129040155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540435995',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6oL/7vvy9taX59bYI1WkM2HscWCZsFVsysC1exh/0Cmaz5gesQgSdKJwRW00bX89IFpRG0IkpITdH7sGiUa2XGjjHsEJIxVsYERrNHqSdOkmfTf8b+AU/z+Ywzde3ffQ==',key_name='tempest-keypair-1295110036',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='93335bb18c124da8b9eb12111d71ff4f',ramdisk_id='',reservation_id='r-1occtchr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647964474',owner_user_name='tempest-ServerActionsV293TestJSON-647964474-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc933353e4e643ea86c6dfb0337302b1',uuid=b8e8fdb2-f3a6-45dc-96d2-b9703922ef10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converting VIF {"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_vif [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31e9206c-660a-518c-b0db-269fe32067fb', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[128517f7-cbc4-4543-9a48-0b4c61cf0c7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:37:56 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap547b5c17-1d, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap547b5c17-1d, col_values=(('qos', UUID('cae27cba-c7b6-4fcc-928c-c05ffce63964')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap547b5c17-1d, col_values=(('external_ids', {'iface-id': '547b5c17-1da6-4e8e-92fa-4edd0aabcdad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:e0:37', 'vm-uuid': 'b8e8fdb2-f3a6-45dc-96d2-b9703922ef10'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:56 user nova-compute[75203]: INFO os_vif [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d')
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f014c11-5082-4516-a883-cdf890cd3915]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d] added
Nov 28 18:37:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b976b4-7974-49e9-b796-c8c88dafbcf2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd20f75-868a-4262-906c-49a092f8a1d1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhlceikj {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] No VIF found with MAC fa:16:3e:73:e0:37, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhlceikj" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af73d3d-039a-4deb-ad3f-a2e82de6939f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yhlceikj'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e5071f-395e-41a0-8e80-da47e05656da]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c02f5-9602-4513-ae8e-cb20b77a86ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[520f1b60-90de-474a-8f13-c993b882a5c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260]
Nov 28 18:37:56 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260] successful.
Nov 28 18:37:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5fcf6-e5d4-44c0-ad36-6ae959facdf4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e371b-6452-447c-bc88-3e772510caa0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:37:56 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:37:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c13d120-880d-4307-94a7-f8d2a152cb65]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:37:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhlceikj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23164306463353965', 'path': '/dev/sdf'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164306463353965', 'path': '/dev/sdf'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG nova.objects.instance [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lazy-loading 'flavor' on Instance uuid eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:37:57 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:37:57 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:37:57 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:37:57 user nova-compute[75203]:   <serial>279129b2-2b52-490d-9664-6c6ea206321d</serial>
Nov 28 18:37:57 user nova-compute[75203]: </disk>
Nov 28 18:37:57 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:37:57 user nova-compute[75203]: INFO nova.compute.claims [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Claim successful on node user
Nov 28 18:37:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] No VIF found with MAC fa:16:3e:91:98:94, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.policy [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72568e67e6f34f6584962ffea5d48f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89044cd2ec4716af0b204c9b107772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:37:58 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-27e0edd1-7c7a-4b11-88ea-0e43f3d8d03c tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.466s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:37:58 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Creating image(s)
Nov 28 18:37:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "/opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "/opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "/opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk 1073741824" returned: 0 in 0.069s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Successfully created port: 7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.243s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Cannot resize image /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Ensure instance console log exists: /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:37:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:37:59 user nova-compute[75203]: INFO nova.compute.claims [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Claim successful on node user
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Successfully updated port: 7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquired lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received event network-changed-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Refreshing instance network info cache due to event network-changed-7ba4460a-57bd-4b62-945e-9878a64dfa5a. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] Acquiring lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:38:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance spawned successfully.
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Updating instance_info_cache with network_info: [{"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Releasing lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Instance network_info: |[{"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] Acquired lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Refreshing network info cache for port 7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Start _get_guest_xml network_info=[{"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:38:00 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:00 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1638521000',display_name='tempest-ServersNegativeTestJSON-server-1638521000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1638521000',id=13,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e89044cd2ec4716af0b204c9b107772',ramdisk_id='',reservation_id='r-bnd727ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-617619106',owner_user_name='tempest-ServersNegativeTestJSON-617619106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:37:59Z,user_data=None,user_id='72568e67e6f34f6584962ffea5d48f6f',uuid=092dc38f-5bfc-47ba-8cc2-61cf2eea21f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converting VIF {"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:e6,bridge_name='br-int',has_traffic_filtering=True,id=7ba4460a-57bd-4b62-945e-9878a64dfa5a,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4460a-57') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lazy-loading 'pci_devices' on Instance uuid 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:38:00 user nova-compute[75203]:   <uuid>092dc38f-5bfc-47ba-8cc2-61cf2eea21f0</uuid>
Nov 28 18:38:00 user nova-compute[75203]:   <name>instance-0000000d</name>
Nov 28 18:38:00 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:38:00 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:38:00 user nova-compute[75203]:   <metadata>
Nov 28 18:38:00 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:38:00 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:38:00 user nova-compute[75203]:       <nova:name>tempest-ServersNegativeTestJSON-server-1638521000</nova:name>
Nov 28 18:38:00 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:38:00</nova:creationTime>
Nov 28 18:38:00 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:38:00 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:38:00 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:38:00 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:38:00 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:38:00 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:38:00 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:38:00 user nova-compute[75203]:       <nova:owner>
Nov 28 18:38:00 user nova-compute[75203]:         <nova:user uuid="72568e67e6f34f6584962ffea5d48f6f">tempest-ServersNegativeTestJSON-617619106-project-member</nova:user>
Nov 28 18:38:00 user nova-compute[75203]:         <nova:project uuid="9e89044cd2ec4716af0b204c9b107772">tempest-ServersNegativeTestJSON-617619106</nova:project>
Nov 28 18:38:00 user nova-compute[75203]:       </nova:owner>
Nov 28 18:38:00 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:38:00 user nova-compute[75203]:       <nova:ports>
Nov 28 18:38:00 user nova-compute[75203]:         <nova:port uuid="7ba4460a-57bd-4b62-945e-9878a64dfa5a">
Nov 28 18:38:00 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 18:38:00 user nova-compute[75203]:         </nova:port>
Nov 28 18:38:00 user nova-compute[75203]:       </nova:ports>
Nov 28 18:38:00 user nova-compute[75203]:     </nova:instance>
Nov 28 18:38:00 user nova-compute[75203]:   </metadata>
Nov 28 18:38:00 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:38:00 user nova-compute[75203]:     <system>
Nov 28 18:38:00 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:38:00 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:38:00 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:38:00 user nova-compute[75203]:       <entry name="serial">092dc38f-5bfc-47ba-8cc2-61cf2eea21f0</entry>
Nov 28 18:38:00 user nova-compute[75203]:       <entry name="uuid">092dc38f-5bfc-47ba-8cc2-61cf2eea21f0</entry>
Nov 28 18:38:00 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:38:00 user nova-compute[75203]:     </system>
Nov 28 18:38:00 user nova-compute[75203]:   </sysinfo>
Nov 28 18:38:00 user nova-compute[75203]:   <os>
Nov 28 18:38:00 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:38:00 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:38:00 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:38:00 user nova-compute[75203]:   </os>
Nov 28 18:38:00 user nova-compute[75203]:   <features>
Nov 28 18:38:00 user nova-compute[75203]:     <acpi/>
Nov 28 18:38:00 user nova-compute[75203]:     <apic/>
Nov 28 18:38:00 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:38:00 user nova-compute[75203]:   </features>
Nov 28 18:38:00 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:38:00 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:38:00 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:38:00 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:38:00 user nova-compute[75203]:   </clock>
Nov 28 18:38:00 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:38:00 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:38:00 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:38:00 user nova-compute[75203]:   </cpu>
Nov 28 18:38:00 user nova-compute[75203]:   <devices>
Nov 28 18:38:00 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:38:00 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:38:00 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk"/>
Nov 28 18:38:00 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:38:00 user nova-compute[75203]:     </disk>
Nov 28 18:38:00 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:38:00 user nova-compute[75203]:       <mac address="fa:16:3e:ce:c6:e6"/>
Nov 28 18:38:00 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:00 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:38:00 user nova-compute[75203]:       <target dev="tap7ba4460a-57"/>
Nov 28 18:38:00 user nova-compute[75203]:     </interface>
Nov 28 18:38:00 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:38:00 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/console.log" append="off"/>
Nov 28 18:38:00 user nova-compute[75203]:     </serial>
Nov 28 18:38:00 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:38:00 user nova-compute[75203]:     <video>
Nov 28 18:38:00 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:00 user nova-compute[75203]:     </video>
Nov 28 18:38:00 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:38:00 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:38:00 user nova-compute[75203]:     </rng>
Nov 28 18:38:00 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:38:00 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:38:00 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:38:00 user nova-compute[75203]:     </memballoon>
Nov 28 18:38:00 user nova-compute[75203]:   </devices>
Nov 28 18:38:00 user nova-compute[75203]: </domain>
Nov 28 18:38:00 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1638521000',display_name='tempest-ServersNegativeTestJSON-server-1638521000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1638521000',id=13,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e89044cd2ec4716af0b204c9b107772',ramdisk_id='',reservation_id='r-bnd727ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-617619106',owner_user_name='tempest-ServersNegativeTestJSON-617619106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:37:59Z,user_data=None,user_id='72568e67e6f34f6584962ffea5d48f6f',uuid=092dc38f-5bfc-47ba-8cc2-61cf2eea21f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converting VIF {"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:e6,bridge_name='br-int',has_traffic_filtering=True,id=7ba4460a-57bd-4b62-945e-9878a64dfa5a,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4460a-57') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG os_vif [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:e6,bridge_name='br-int',has_traffic_filtering=True,id=7ba4460a-57bd-4b62-945e-9878a64dfa5a,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4460a-57') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.116s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75203) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aaa04af9-ebc3-5429-aa30-e074d12b6592', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ba4460a-57, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ba4460a-57, col_values=(('qos', UUID('276491d7-fc45-4293-9c0f-9cdea198f2a3')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ba4460a-57, col_values=(('external_ids', {'iface-id': '7ba4460a-57bd-4b62-945e-9878a64dfa5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:c6:e6', 'vm-uuid': '092dc38f-5bfc-47ba-8cc2-61cf2eea21f0'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:00 user nova-compute[75203]: INFO os_vif [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:c6:e6,bridge_name='br-int',has_traffic_filtering=True,id=7ba4460a-57bd-4b62-945e-9878a64dfa5a,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4460a-57')
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:38:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2da6d2c3-149b-4818-95ce-4bfa9434ddb0 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.126s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] No VIF found with MAC fa:16:3e:ce:c6:e6, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.policy [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0bbf1727aff4c61b80cc15f640a20f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2feb0fa92b6443b1afa886bfd04e7f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:38:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Creating image(s)
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "/opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "/opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Updated VIF entry in instance network info cache for port 7ba4460a-57bd-4b62-945e-9878a64dfa5a. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Updating instance_info_cache with network_info: [{"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4269dfa4-c8cb-480b-bb0a-4d4c6d618e1e req-5954a739-64a3-4c9a-85d6-aa910b2b3033 service nova] Releasing lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk 1073741824" returned: 0 in 0.052s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Successfully created port: 15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Cannot resize image /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Ensure instance console log exists: /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Successfully updated port: 15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "refresh_cache-1c277046-cdb1-4499-b8d2-8c18d9913dd9" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquired lock "refresh_cache-1c277046-cdb1-4499-b8d2-8c18d9913dd9" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received event network-changed-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Refreshing instance network info cache due to event network-changed-15cf3830-814d-4fa2-b901-1245c9fa028e. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:38:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] Acquiring lock "refresh_cache-1c277046-cdb1-4499-b8d2-8c18d9913dd9" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Updating instance_info_cache with network_info: [{"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Releasing lock "refresh_cache-1c277046-cdb1-4499-b8d2-8c18d9913dd9" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Instance network_info: |[{"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] Acquired lock "refresh_cache-1c277046-cdb1-4499-b8d2-8c18d9913dd9" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Refreshing network info cache for port 15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Start _get_guest_xml network_info=[{"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:38:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-371110027',display_name='tempest-VolumesAdminNegativeTest-server-371110027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-371110027',id=14,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2feb0fa92b6443b1afa886bfd04e7f80',ramdisk_id='',reservation_id='r-3j51w71q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1771058656',owner_user_name='tempest-VolumesAdminNegativeTest-1771058656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:38:01Z,user_data=None,user_id='b0bbf1727aff4c61b80cc15f640a20f6',uuid=1c277046-cdb1-4499-b8d2-8c18d9913dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converting VIF {"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:89:d1,bridge_name='br-int',has_traffic_filtering=True,id=15cf3830-814d-4fa2-b901-1245c9fa028e,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15cf3830-81') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c277046-cdb1-4499-b8d2-8c18d9913dd9 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:38:02 user nova-compute[75203]:   <uuid>1c277046-cdb1-4499-b8d2-8c18d9913dd9</uuid>
Nov 28 18:38:02 user nova-compute[75203]:   <name>instance-0000000e</name>
Nov 28 18:38:02 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:38:02 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:38:02 user nova-compute[75203]:   <metadata>
Nov 28 18:38:02 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:38:02 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:38:02 user nova-compute[75203]:       <nova:name>tempest-VolumesAdminNegativeTest-server-371110027</nova:name>
Nov 28 18:38:02 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:38:02</nova:creationTime>
Nov 28 18:38:02 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:38:02 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:38:02 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:38:02 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:38:02 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:38:02 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:38:02 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:38:02 user nova-compute[75203]:       <nova:owner>
Nov 28 18:38:02 user nova-compute[75203]:         <nova:user uuid="b0bbf1727aff4c61b80cc15f640a20f6">tempest-VolumesAdminNegativeTest-1771058656-project-member</nova:user>
Nov 28 18:38:02 user nova-compute[75203]:         <nova:project uuid="2feb0fa92b6443b1afa886bfd04e7f80">tempest-VolumesAdminNegativeTest-1771058656</nova:project>
Nov 28 18:38:02 user nova-compute[75203]:       </nova:owner>
Nov 28 18:38:02 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:38:02 user nova-compute[75203]:       <nova:ports>
Nov 28 18:38:02 user nova-compute[75203]:         <nova:port uuid="15cf3830-814d-4fa2-b901-1245c9fa028e">
Nov 28 18:38:02 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 18:38:02 user nova-compute[75203]:         </nova:port>
Nov 28 18:38:02 user nova-compute[75203]:       </nova:ports>
Nov 28 18:38:02 user nova-compute[75203]:     </nova:instance>
Nov 28 18:38:02 user nova-compute[75203]:   </metadata>
Nov 28 18:38:02 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:38:02 user nova-compute[75203]:     <system>
Nov 28 18:38:02 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:38:02 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:38:02 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:38:02 user nova-compute[75203]:       <entry name="serial">1c277046-cdb1-4499-b8d2-8c18d9913dd9</entry>
Nov 28 18:38:02 user nova-compute[75203]:       <entry name="uuid">1c277046-cdb1-4499-b8d2-8c18d9913dd9</entry>
Nov 28 18:38:02 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:38:02 user nova-compute[75203]:     </system>
Nov 28 18:38:02 user nova-compute[75203]:   </sysinfo>
Nov 28 18:38:02 user nova-compute[75203]:   <os>
Nov 28 18:38:02 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:38:02 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:38:02 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:38:02 user nova-compute[75203]:   </os>
Nov 28 18:38:02 user nova-compute[75203]:   <features>
Nov 28 18:38:02 user nova-compute[75203]:     <acpi/>
Nov 28 18:38:02 user nova-compute[75203]:     <apic/>
Nov 28 18:38:02 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:38:02 user nova-compute[75203]:   </features>
Nov 28 18:38:02 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:38:02 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:38:02 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:38:02 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:38:02 user nova-compute[75203]:   </clock>
Nov 28 18:38:02 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:38:02 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:38:02 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:38:02 user nova-compute[75203]:   </cpu>
Nov 28 18:38:02 user nova-compute[75203]:   <devices>
Nov 28 18:38:02 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:38:02 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:38:02 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk"/>
Nov 28 18:38:02 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:38:02 user nova-compute[75203]:     </disk>
Nov 28 18:38:02 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:38:02 user nova-compute[75203]:       <mac address="fa:16:3e:45:89:d1"/>
Nov 28 18:38:02 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:02 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:38:02 user nova-compute[75203]:       <target dev="tap15cf3830-81"/>
Nov 28 18:38:02 user nova-compute[75203]:     </interface>
Nov 28 18:38:02 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:38:02 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/console.log" append="off"/>
Nov 28 18:38:02 user nova-compute[75203]:     </serial>
Nov 28 18:38:02 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:38:02 user nova-compute[75203]:     <video>
Nov 28 18:38:02 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:02 user nova-compute[75203]:     </video>
Nov 28 18:38:02 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:38:02 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:38:02 user nova-compute[75203]:     </rng>
Nov 28 18:38:02 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:38:02 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:38:02 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:38:02 user nova-compute[75203]:     </memballoon>
Nov 28 18:38:02 user nova-compute[75203]:   </devices>
Nov 28 18:38:02 user nova-compute[75203]: </domain>
Nov 28 18:38:02 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-371110027',display_name='tempest-VolumesAdminNegativeTest-server-371110027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-371110027',id=14,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2feb0fa92b6443b1afa886bfd04e7f80',ramdisk_id='',reservation_id='r-3j51w71q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1771058656',owner_user_name='tempest-VolumesAdminNegativeTest-1771058656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:38:01Z,user_data=None,user_id='b0bbf1727aff4c61b80cc15f640a20f6',uuid=1c277046-cdb1-4499-b8d2-8c18d9913dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converting VIF {"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:89:d1,bridge_name='br-int',has_traffic_filtering=True,id=15cf3830-814d-4fa2-b901-1245c9fa028e,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15cf3830-81') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG os_vif [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:89:d1,bridge_name='br-int',has_traffic_filtering=True,id=15cf3830-814d-4fa2-b901-1245c9fa028e,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15cf3830-81') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1786a242-06cc-5b0d-a044-a38e520ff952', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15cf3830-81, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15cf3830-81, col_values=(('qos', UUID('b4edda70-a019-4ff2-b676-482ed053addf')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15cf3830-81, col_values=(('external_ids', {'iface-id': '15cf3830-814d-4fa2-b901-1245c9fa028e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:89:d1', 'vm-uuid': '1c277046-cdb1-4499-b8d2-8c18d9913dd9'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.objects.instance [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lazy-loading 'flavor' on Instance uuid eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: INFO os_vif [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:89:d1,bridge_name='br-int',has_traffic_filtering=True,id=15cf3830-814d-4fa2-b901-1245c9fa028e,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15cf3830-81')
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] No VIF found with MAC fa:16:3e:45:89:d1, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:02 user nova-compute[75203]: INFO nova.compute.manager [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Attaching volume 6cb50158-3591-42d0-8cad-0b59cb5222fb to /dev/vdc
Nov 28 18:38:02 user nova-compute[75203]: DEBUG os_brick.utils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Updated VIF entry in instance network info cache for port 15cf3830-814d-4fa2-b901-1245c9fa028e. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Updating instance_info_cache with network_info: [{"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef02e7a-625b-4346-ae27-bb3976b74d6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ff41ddfd-ace3-442e-b0ce-4c32b73cbbcc req-015591ea-c8af-442f-b9f9-c08e405790c5 service nova] Releasing lock "refresh_cache-1c277046-cdb1-4499-b8d2-8c18d9913dd9" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fc69db-ee5d-4936-b177-f73a8051808f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d8758-4593-404e-b77a-704b935efb33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[41acb6d2-e41f-429e-8fa2-a71665b84ff0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:38:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:38:03 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:38:03 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7015cf4d-54cc-4e3c-9f4d-57f986050937]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG os_brick.utils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updating existing volume attachment record: ff5b5085-aa87-4eec-ab03-5aaab4b9e2cb {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-adcb2cec-b028-4edd-89cc-e31516855c0b req-0f21db9f-9b28-4d35-8a7a-219ccee5b5f2 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-adcb2cec-b028-4edd-89cc-e31516855c0b req-0f21db9f-9b28-4d35-8a7a-219ccee5b5f2 service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-adcb2cec-b028-4edd-89cc-e31516855c0b req-0f21db9f-9b28-4d35-8a7a-219ccee5b5f2 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-adcb2cec-b028-4edd-89cc-e31516855c0b req-0f21db9f-9b28-4d35-8a7a-219ccee5b5f2 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-adcb2cec-b028-4edd-89cc-e31516855c0b req-0f21db9f-9b28-4d35-8a7a-219ccee5b5f2 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:03 user nova-compute[75203]: WARNING nova.compute.manager [req-adcb2cec-b028-4edd-89cc-e31516855c0b req-0f21db9f-9b28-4d35-8a7a-219ccee5b5f2 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received unexpected event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with vm_state active and task_state None.
Nov 28 18:38:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:38:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Instance spawned successfully.
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:05 user nova-compute[75203]: WARNING nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received unexpected event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with vm_state active and task_state None.
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received event network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] No waiting events found dispatching network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:05 user nova-compute[75203]: WARNING nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received unexpected event network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a for instance with vm_state building and task_state spawning.
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received event network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] No waiting events found dispatching network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:05 user nova-compute[75203]: WARNING nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received unexpected event network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a for instance with vm_state building and task_state spawning.
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received event network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Acquiring lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] No waiting events found dispatching network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:05 user nova-compute[75203]: WARNING nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received unexpected event network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e for instance with vm_state building and task_state spawning.
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received event network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Acquiring lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] No waiting events found dispatching network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:05 user nova-compute[75203]: WARNING nova.compute.manager [req-047c90c7-6b4e-4dd5-864b-9f426a38f240 req-e1b9e90d-c3af-4c80-a51b-dba16a3492f3 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received unexpected event network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e for instance with vm_state building and task_state spawning.
Nov 28 18:38:05 user nova-compute[75203]: INFO nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 28 18:38:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:38:05 user nova-compute[75203]: INFO nova.compute.manager [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Took 7.54 seconds to build instance.
Nov 28 18:38:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5116155d-6084-4315-8ae1-f8bbfc65c8ba tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.634s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:38:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Instance spawned successfully.
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:06 user nova-compute[75203]: INFO nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:38:06 user nova-compute[75203]: INFO nova.compute.manager [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Took 6.85 seconds to build instance.
Nov 28 18:38:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5ad9105c-9506-4d39-a987-27c60c640d95 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.961s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72f841aa-13fb-4373-9225-2df8a700e045 is timed out.
Nov 28 18:38:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Successfully detached device vdb from instance 72f841aa-13fb-4373-9225-2df8a700e045 from the live domain config.
Nov 28 18:38:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hzJfgyIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '14236553-7e44-43c8-a297-c954abfedf00'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:38:06 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:38:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db991c-7c54-4c8a-b480-a517b1a6beb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:38:06 user nova-compute[75203]: No targets found.
Nov 28 18:38:06 user nova-compute[75203]: iSNS:
Nov 28 18:38:06 user nova-compute[75203]: No targets found.
Nov 28 18:38:06 user nova-compute[75203]: STATIC:
Nov 28 18:38:06 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:38:06 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:06 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:06 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8
Nov 28 18:38:06 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:06 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:06 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:38:06 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:06 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:06 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:38:06 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:06 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:06 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:38:06 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:06 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:06 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00
Nov 28 18:38:06 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:06 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:06 user nova-compute[75203]: FIRMWARE:
Nov 28 18:38:06 user nova-compute[75203]: No targets found.
Nov 28 18:38:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:38:06 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:38:06 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:38:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad08000-8e88-41e1-b1af-76427a081641]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d686f-9629-4b9e-a0e7-e03892cc8976]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:07 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:38:07 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:07 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903e0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00'): ({'sdg'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Removing single pathed devices sdg {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45f7e4-a7dc-4ecc-9c5e-0dc6b63504a8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a71bef8-f6d0-4e12-92fc-0ec981dbfd1a]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Flushing IO for device /dev/sdg {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c051c31b-9178-4418-bf31-4c0d0e77218b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[396bc591-1d88-4857-88e9-37b74906c2ac]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] SCSI volumes sdg have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2720e1a9-d868-4cf9-b856-fced567442a5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d495d61-c753-4512-a1ef-2866cab8ae08]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260]
Nov 28 18:38:07 user nova-compute[75203]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00, portal: 172.16.0.220,3260] successful.
Nov 28 18:38:07 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14236553-7e44-43c8-a297-c954abfedf00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d572a-6cdf-406f-8de9-a471e6f88c7e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] <== disconnect_volume: return (362ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:08 user nova-compute[75203]: DEBUG nova.objects.instance [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lazy-loading 'flavor' on Instance uuid 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-759e179a-5df4-4d6e-87fc-2b29bfcca727 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.928s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.volume.cinder [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Update attachment failed for attachment ff5b5085-aa87-4eec-ab03-5aaab4b9e2cb. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c3167451-07d9-4f38-bb84-94c8e87a9667) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c3167451-07d9-4f38-bb84-94c8e87a9667)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Failed to attach 6cb50158-3591-42d0-8cad-0b59cb5222fb at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c3167451-07d9-4f38-bb84-94c8e87a9667)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Traceback (most recent call last):
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     ret_val = method(obj, context, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     self._do_attach(context, instance, volume, volume_api,
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     self._volume_attach(context, volume, connector, instance,
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     connection_info = volume_api.attachment_update(
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     res = method(self, ctx, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     with excutils.save_and_reraise_exception():
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     self.force_reraise()
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     raise self.value
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     return method.func(obj, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     resp = self._update('/attachments/%s' % id, body)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     return self.request(url, method, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d]     raise exceptions.from_response(resp, body)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c3167451-07d9-4f38-bb84-94c8e87a9667)
Nov 28 18:38:08 user nova-compute[75203]: ERROR nova.compute.manager [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] 
Nov 28 18:38:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.817s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server [None req-a3d507ac-5005-4869-bfa8-6c33139f8303 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c3167451-07d9-4f38-bb84-94c8e87a9667)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c3167451-07d9-4f38-bb84-94c8e87a9667)
Nov 28 18:38:08 user nova-compute[75203]: ERROR oslo_messaging.rpc.server 
Nov 28 18:38:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:15 user nova-compute[75203]: INFO nova.compute.manager [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Terminating instance
Nov 28 18:38:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-abe8b84d-5471-495b-97fe-2184efc13955 req-1908194c-bea7-463f-bca1-4123c6bdeb8a service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-vif-unplugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-abe8b84d-5471-495b-97fe-2184efc13955 req-1908194c-bea7-463f-bca1-4123c6bdeb8a service nova] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-abe8b84d-5471-495b-97fe-2184efc13955 req-1908194c-bea7-463f-bca1-4123c6bdeb8a service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-abe8b84d-5471-495b-97fe-2184efc13955 req-1908194c-bea7-463f-bca1-4123c6bdeb8a service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-abe8b84d-5471-495b-97fe-2184efc13955 req-1908194c-bea7-463f-bca1-4123c6bdeb8a service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] No waiting events found dispatching network-vif-unplugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-abe8b84d-5471-495b-97fe-2184efc13955 req-1908194c-bea7-463f-bca1-4123c6bdeb8a service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-vif-unplugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Instance destroyed successfully.
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lazy-loading 'resources' on Instance uuid a233bb09-8c6e-44d0-945f-ee219a6e1bfa {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1275372563',display_name='tempest-VolumesAssistedSnapshotsTest-server-1275372563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1275372563',id=8,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSDKDOyoA50IykOcPcwZMwj1/NCArQSKD9IkTZ49ITJnbiR5BozHbuRb+Vgckj0Qx43iqZGM5cr45WSxOs/m46CDMSjAJHRznXRz7tERn1H167CHLjovYdUsLB67SsRvw==',key_name='tempest-keypair-596320098',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d291690301244eb495c371c6b5ccc3fd',ramdisk_id='',reservation_id='r-4yrad7cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1665206057',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1665206057-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:35:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3684f12fd03a4eeb95b13e13cd21f7a2',uuid=a233bb09-8c6e-44d0-945f-ee219a6e1bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Converting VIF {"id": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "address": "fa:16:3e:8d:68:9d", "network": {"id": "bfe34745-c11f-46e3-8006-cc78186840fc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-611142954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d291690301244eb495c371c6b5ccc3fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c81299-ac", "ovs_interfaceid": "e0c81299-ac22-4675-a91b-3e8ce5d9c9ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0c81299-ac22-4675-a91b-3e8ce5d9c9ef,network=Network(bfe34745-c11f-46e3-8006-cc78186840fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c81299-ac') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG os_vif [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0c81299-ac22-4675-a91b-3e8ce5d9c9ef,network=Network(bfe34745-c11f-46e3-8006-cc78186840fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c81299-ac') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0c81299-ac, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bee85c6d-83ea-4759-a478-8bc2a46bc114) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:16 user nova-compute[75203]: INFO os_vif [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:68:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0c81299-ac22-4675-a91b-3e8ce5d9c9ef,network=Network(bfe34745-c11f-46e3-8006-cc78186840fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c81299-ac')
Nov 28 18:38:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Deleting instance files /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa_del
Nov 28 18:38:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Deletion of /opt/stack/data/nova/instances/a233bb09-8c6e-44d0-945f-ee219a6e1bfa_del complete
Nov 28 18:38:16 user nova-compute[75203]: INFO nova.compute.manager [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 18:38:16 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:38:16 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:38:17 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:17 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Took 0.89 seconds to deallocate network for instance.
Nov 28 18:38:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-8f0a14a2-7f0d-4f0e-b4dc-2a707280cfe5 req-ca531675-fc0c-4320-8d26-1ce51e92eec7 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-vif-deleted-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:18 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:38:18 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:38:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:18 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Deleted allocations for instance a233bb09-8c6e-44d0-945f-ee219a6e1bfa
Nov 28 18:38:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-b895f98b-2177-4283-8600-44dbc28aab21 req-821ff59e-2b6c-47f7-8c5c-f4a0c96477f9 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received event network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b895f98b-2177-4283-8600-44dbc28aab21 req-821ff59e-2b6c-47f7-8c5c-f4a0c96477f9 service nova] Acquiring lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b895f98b-2177-4283-8600-44dbc28aab21 req-821ff59e-2b6c-47f7-8c5c-f4a0c96477f9 service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b895f98b-2177-4283-8600-44dbc28aab21 req-821ff59e-2b6c-47f7-8c5c-f4a0c96477f9 service nova] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-b895f98b-2177-4283-8600-44dbc28aab21 req-821ff59e-2b6c-47f7-8c5c-f4a0c96477f9 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] No waiting events found dispatching network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:18 user nova-compute[75203]: WARNING nova.compute.manager [req-b895f98b-2177-4283-8600-44dbc28aab21 req-821ff59e-2b6c-47f7-8c5c-f4a0c96477f9 service nova] [instance: a233bb09-8c6e-44d0-945f-ee219a6e1bfa] Received unexpected event network-vif-plugged-e0c81299-ac22-4675-a91b-3e8ce5d9c9ef for instance with vm_state deleted and task_state None.
Nov 28 18:38:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a0d27d5-e30d-4719-a7df-0b5c8b7475df tempest-VolumesAssistedSnapshotsTest-1665206057 tempest-VolumesAssistedSnapshotsTest-1665206057-project-member] Lock "a233bb09-8c6e-44d0-945f-ee219a6e1bfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:30 user nova-compute[75203]: DEBUG nova.compute.manager [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-changed-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:30 user nova-compute[75203]: DEBUG nova.compute.manager [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing instance network info cache due to event network-changed-9d8bae68-1062-4edb-b1b3-27ff8b55b225. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:38:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] Acquiring lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] Acquired lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:30 user nova-compute[75203]: DEBUG nova.network.neutron [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Refreshing network info cache for port 9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:38:30 user nova-compute[75203]: DEBUG nova.network.neutron [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updated VIF entry in instance network info cache for port 9d8bae68-1062-4edb-b1b3-27ff8b55b225. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:38:30 user nova-compute[75203]: DEBUG nova.network.neutron [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-72e3b147-036e-4fca-9dc9-733dae97e31a req-a5699382-6b0a-48aa-9509-de61a9184039 service nova] Releasing lock "refresh_cache-16c72606-ed4c-4c7a-8295-a76da36da957" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "16c72606-ed4c-4c7a-8295-a76da36da957" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:33 user nova-compute[75203]: INFO nova.compute.manager [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Terminating instance
Nov 28 18:38:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-4153f50d-b37c-4323-9f29-e6128b8d1a29 req-9f1fee5a-f432-4a7b-b9c6-63b4c9a01977 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4153f50d-b37c-4323-9f29-e6128b8d1a29 req-9f1fee5a-f432-4a7b-b9c6-63b4c9a01977 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4153f50d-b37c-4323-9f29-e6128b8d1a29 req-9f1fee5a-f432-4a7b-b9c6-63b4c9a01977 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4153f50d-b37c-4323-9f29-e6128b8d1a29 req-9f1fee5a-f432-4a7b-b9c6-63b4c9a01977 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-4153f50d-b37c-4323-9f29-e6128b8d1a29 req-9f1fee5a-f432-4a7b-b9c6-63b4c9a01977 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-unplugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-4153f50d-b37c-4323-9f29-e6128b8d1a29 req-9f1fee5a-f432-4a7b-b9c6-63b4c9a01977 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-a08b8e5e-0997-4208-9eed-f9dd6c73f3c1 req-d300124b-932d-4099-a042-65a4d44627af service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a08b8e5e-0997-4208-9eed-f9dd6c73f3c1 req-d300124b-932d-4099-a042-65a4d44627af service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a08b8e5e-0997-4208-9eed-f9dd6c73f3c1 req-d300124b-932d-4099-a042-65a4d44627af service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a08b8e5e-0997-4208-9eed-f9dd6c73f3c1 req-d300124b-932d-4099-a042-65a4d44627af service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-a08b8e5e-0997-4208-9eed-f9dd6c73f3c1 req-d300124b-932d-4099-a042-65a4d44627af service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-unplugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-a08b8e5e-0997-4208-9eed-f9dd6c73f3c1 req-d300124b-932d-4099-a042-65a4d44627af service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:33 user nova-compute[75203]: INFO nova.compute.manager [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Unshelving
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:33 user nova-compute[75203]: INFO nova.virt.block_device [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Booting with volume b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 at /dev/vdc
Nov 28 18:38:34 user nova-compute[75203]: DEBUG os_brick.utils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12b7e6e-3d0d-4c83-bbf1-e3aba085bd40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2ce8db-26a2-4b90-bc49-1214079eeb73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d0a10e-a404-4093-80b4-567b52567754]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe7e93-509a-4f85-bb9c-71f00c3729cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:38:34 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b9b86-ccf6-498e-b9bc-6fdea0634b12]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG os_brick.utils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating existing volume attachment record: a9265f9a-e8b3-4137-87c7-42e592d9bb7c {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-a1c51aba-260f-434d-92c2-1d0a6fa9659f req-5e26bdb0-d537-4a7a-aa89-e13fdd5d3c0c service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a1c51aba-260f-434d-92c2-1d0a6fa9659f req-5e26bdb0-d537-4a7a-aa89-e13fdd5d3c0c service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a1c51aba-260f-434d-92c2-1d0a6fa9659f req-5e26bdb0-d537-4a7a-aa89-e13fdd5d3c0c service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a1c51aba-260f-434d-92c2-1d0a6fa9659f req-5e26bdb0-d537-4a7a-aa89-e13fdd5d3c0c service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-a1c51aba-260f-434d-92c2-1d0a6fa9659f req-5e26bdb0-d537-4a7a-aa89-e13fdd5d3c0c service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-unplugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-a1c51aba-260f-434d-92c2-1d0a6fa9659f req-5e26bdb0-d537-4a7a-aa89-e13fdd5d3c0c service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-8e2db7ae-c549-4368-852e-68494ac2f978 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Instance destroyed successfully.
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lazy-loading 'resources' on Instance uuid 16c72606-ed4c-4c7a-8295-a76da36da957 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:a6:56,bridge_name='br-int',has_traffic_filtering=True,id=9d8bae68-1062-4edb-b1b3-27ff8b55b225,network=Network(d75fd7cf-22c0-4e71-bfe1-899659f543a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8bae68-10') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:a6:56,bridge_name='br-int',has_traffic_filtering=True,id=9d8bae68-1062-4edb-b1b3-27ff8b55b225,network=Network(d75fd7cf-22c0-4e71-bfe1-899659f543a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8bae68-10') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d8bae68-10, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5296304-0814-42bf-b20d-832b7b2d985f) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: INFO os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:a6:56,bridge_name='br-int',has_traffic_filtering=True,id=9d8bae68-1062-4edb-b1b3-27ff8b55b225,network=Network(d75fd7cf-22c0-4e71-bfe1-899659f543a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8bae68-10')
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:0b,bridge_name='br-int',has_traffic_filtering=True,id=d28852c4-aebd-4cc2-af45-f02e6b6226b7,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd28852c4-ae') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:0b,bridge_name='br-int',has_traffic_filtering=True,id=d28852c4-aebd-4cc2-af45-f02e6b6226b7,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd28852c4-ae') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd28852c4-ae, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e277dc67-bddc-4e24-8764-abfd76d8bf89) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: INFO os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:0b,bridge_name='br-int',has_traffic_filtering=True,id=d28852c4-aebd-4cc2-af45-f02e6b6226b7,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd28852c4-ae')
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=986fa26d-73d2-4879-9213-2adb023290d8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986fa26d-73') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=986fa26d-73d2-4879-9213-2adb023290d8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986fa26d-73') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap986fa26d-73, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c80fcf51-3e1e-4029-8326-142f6e85d73e) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: INFO os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=986fa26d-73d2-4879-9213-2adb023290d8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap986fa26d-73')
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:51,bridge_name='br-int',has_traffic_filtering=True,id=5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4c741b-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:51,bridge_name='br-int',has_traffic_filtering=True,id=5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4c741b-1d') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b4c741b-1d, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccee6161-e10b-4e7e-aa83-e5cfcb2af664) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: INFO os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:80:51,bridge_name='br-int',has_traffic_filtering=True,id=5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4c741b-1d')
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=194b8b2c-3e49-4713-983b-255bddb7c462,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194b8b2c-3e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=194b8b2c-3e49-4713-983b-255bddb7c462,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194b8b2c-3e') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap194b8b2c-3e, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5cc7cc1-ebf8-444e-94d2-09676dcdac7f) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:38:35 user nova-compute[75203]: INFO nova.compute.claims [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Claim successful on node user
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: INFO os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:4e:67,bridge_name='br-int',has_traffic_filtering=True,id=194b8b2c-3e49-4713-983b-255bddb7c462,network=Network(8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194b8b2c-3e')
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "address": "fa:16:3e:00:c9:39", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c28d389-5c", "ovs_interfaceid": "7c28d389-5c32-435b-8ca5-2d6ecfaf03a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c9:39,bridge_name='br-int',has_traffic_filtering=True,id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c28d389-5c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c9:39,bridge_name='br-int',has_traffic_filtering=True,id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c28d389-5c') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c28d389-5c, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad465ab5-1baa-4033-9b90-3d11c2fb0c69) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: INFO os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c9:39,bridge_name='br-int',has_traffic_filtering=True,id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c28d389-5c')
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:35:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1812232109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1812232109',id=11,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGeQkpZHkzoMSdtj8xkSJrf0djuygfOYG9astkjZG+Qfs5U24YeTirkoPbi9atCONsGT7dMP4SD1AB6T9cY8S3Dpc2SqgkH9TuozHHz9vNXi8zChTOFtq0F8JKDjhI6XCw==',key_name='tempest-keypair-2109917305',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='730532d801394235950dc0a30cf94733',ramdisk_id='',reservation_id='r-r54uwgt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1004375661',owner_user_name='tempest-TaggedBootDevicesTest-1004375661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0855ea71a4084541936c00003279c26d',uuid=16c72606-ed4c-4c7a-8295-a76da36da957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converting VIF {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=8e2db7ae-c549-4368-852e-68494ac2f978,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2db7ae-c5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=8e2db7ae-c549-4368-852e-68494ac2f978,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2db7ae-c5') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e2db7ae-c5, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74cd9612-9e48-4d06-9de2-ba341ec293c9) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:35 user nova-compute[75203]: INFO os_vif [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=8e2db7ae-c549-4368-852e-68494ac2f978,network=Network(c7534016-22cd-482b-91e7-854be8b13c86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e2db7ae-c5')
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQhTMzPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:38:35 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22141d3-9b9c-4816-8145-103ac0bea904]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:38:35 user nova-compute[75203]: No targets found.
Nov 28 18:38:35 user nova-compute[75203]: iSNS:
Nov 28 18:38:35 user nova-compute[75203]: No targets found.
Nov 28 18:38:35 user nova-compute[75203]: STATIC:
Nov 28 18:38:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:38:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8
Nov 28 18:38:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:38:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf
Nov 28 18:38:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:38:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:35 user nova-compute[75203]: FIRMWARE:
Nov 28 18:38:35 user nova-compute[75203]: No targets found.
Nov 28 18:38:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:38:35 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:38:35 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: WARNING nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-d28852c4-aebd-4cc2-af45-f02e6b6226b7 for instance with vm_state active and task_state deleting.
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-unplugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-986fa26d-73d2-4879-9213-2adb023290d8 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: WARNING nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-986fa26d-73d2-4879-9213-2adb023290d8 for instance with vm_state active and task_state deleting.
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-unplugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: WARNING nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 for instance with vm_state active and task_state deleting.
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-unplugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-194b8b2c-3e49-4713-983b-255bddb7c462 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: WARNING nova.compute.manager [req-e4ca8734-a69b-4e1a-b1ac-d53d991dff83 req-66dd3261-a43a-4227-820b-6a1158b60e94 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-194b8b2c-3e49-4713-983b-255bddb7c462 for instance with vm_state active and task_state deleting.
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48dff7a-9094-446b-ac59-2fc00c3bacff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4553f81e-e130-4c19-a4c6-a79b3d09f6c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:38:35 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903ca950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eea9d65-06ce-477e-b475-1d4beca20539]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbac1a4-2277-4a4b-99cb-3e71e21023bf]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdccbadd-4d37-4285-b136-0cd3088ff3bb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: WARNING nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-9d8bae68-1062-4edb-b1b3-27ff8b55b225 for instance with vm_state active and task_state deleting.
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-unplugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-unplugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:35 user nova-compute[75203]: WARNING nova.compute.manager [req-a5b8c273-d24a-432f-bcd8-1007556f7cd4 req-a7aaea73-ec0e-4c67-9c54-acb1f63b05c3 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 for instance with vm_state active and task_state deleting.
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b231e9-0792-4345-a19a-edda6c6eaf1a]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b4cefc-c296-45dc-a88c-e92d6d48e5af]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a38252-cb89-4dc1-90a5-42b5e6834bee]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260]
Nov 28 18:38:36 user nova-compute[75203]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf, portal: 172.16.0.220,3260] successful.
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbd80f90-116f-44ba-913b-955f4d331daf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20224b-2186-4f53-ab8c-7012d4461fa2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== disconnect_volume: return (333ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvoaHRfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:38:36 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bef2df-96fb-46ad-ae97-e50f904b77d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:38:36 user nova-compute[75203]: No targets found.
Nov 28 18:38:36 user nova-compute[75203]: iSNS:
Nov 28 18:38:36 user nova-compute[75203]: No targets found.
Nov 28 18:38:36 user nova-compute[75203]: STATIC:
Nov 28 18:38:36 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:38:36 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:36 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:36 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8
Nov 28 18:38:36 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:36 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:36 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e
Nov 28 18:38:36 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:36 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:36 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:38:36 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:36 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:36 user nova-compute[75203]: FIRMWARE:
Nov 28 18:38:36 user nova-compute[75203]: No targets found.
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:38:36 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:38:36 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ea3bcb-fab8-4710-9ea9-85e988d5694f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[52473088-4dd1-43ab-8d52-e58bd55653e9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903f7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e'): ({'sdd'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Removing single pathed devices sdd {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db8538-69f2-4eb2-b4ad-12a6653d4310]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fefe1ce-729c-42fe-82ae-9575a985cd52]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Flushing IO for device /dev/sdd {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4085ff0-9ddc-4a14-9145-455b54be8c24]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.network.neutron [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc8754-7320-49f1-96a8-3a127c2a6ba0]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec8470-2ed8-43da-b7b5-9b17eb47c33d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-a59d4560-7c5f-46f2-be68-8c3aa3921f23 req-32d09f0a-5008-4ff8-b200-5c576c1c2916 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a59d4560-7c5f-46f2-be68-8c3aa3921f23 req-32d09f0a-5008-4ff8-b200-5c576c1c2916 service nova] Acquiring lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a59d4560-7c5f-46f2-be68-8c3aa3921f23 req-32d09f0a-5008-4ff8-b200-5c576c1c2916 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a59d4560-7c5f-46f2-be68-8c3aa3921f23 req-32d09f0a-5008-4ff8-b200-5c576c1c2916 service nova] Lock "16c72606-ed4c-4c7a-8295-a76da36da957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-a59d4560-7c5f-46f2-be68-8c3aa3921f23 req-32d09f0a-5008-4ff8-b200-5c576c1c2916 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] No waiting events found dispatching network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:36 user nova-compute[75203]: WARNING nova.compute.manager [req-a59d4560-7c5f-46f2-be68-8c3aa3921f23 req-32d09f0a-5008-4ff8-b200-5c576c1c2916 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received unexpected event network-vif-plugged-8e2db7ae-c549-4368-852e-68494ac2f978 for instance with vm_state active and task_state deleting.
Nov 28 18:38:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --logout" returned: 0 in 0.157s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d50b7b3-679c-46c4-9d8b-5eabd1493256]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260]
Nov 28 18:38:36 user nova-compute[75203]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e, portal: 172.16.0.220,3260] successful.
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d2bb99-ea26-4c9d-91a7-349afd3dc36e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac5deb8-93f3-42be-aab4-cb4421393bef]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.487s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== disconnect_volume: return (488ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.policy [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b7ea4623ff14b2ea244c31ac84dd600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '974923cb2e06473bbd8e4122888494df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIvMLmHk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:38:36 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b535fb5-8d9b-49cc-b1e1-9d670f2b0726]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:38:36 user nova-compute[75203]: No targets found.
Nov 28 18:38:36 user nova-compute[75203]: iSNS:
Nov 28 18:38:36 user nova-compute[75203]: No targets found.
Nov 28 18:38:36 user nova-compute[75203]: STATIC:
Nov 28 18:38:36 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058
Nov 28 18:38:36 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:36 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:36 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8
Nov 28 18:38:36 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:36 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:36 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:38:36 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:38:36 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:38:36 user nova-compute[75203]: FIRMWARE:
Nov 28 18:38:36 user nova-compute[75203]: No targets found.
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:38:36 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:38:36 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22a9235-aa31-4828-8bde-cd650168e916]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b380dfed-0a9a-4495-8f5a-1e759c99a173]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:36 user nova-compute[75203]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 (non-flash)
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903f4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058'): ({'sde'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Removing single pathed devices sde {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe70dbb2-2970-46f9-8008-0a726262de34]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:38:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Creating image(s)
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[60356727-d172-4e34-b8f9-aa4362deceeb]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Flushing IO for device /dev/sde {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[331d6bda-1df6-497b-9c98-5ba0d464e85a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d771c6-11e0-4f22-8ae4-c78dcb9faa40]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:36 user nova-compute[75203]: INFO nova.compute.manager [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Terminating instance
Nov 28 18:38:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[628f2424-e7e1-4ae7-b347-0c08fb8ea975]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.218s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b581fb-5024-4327-9149-a0f67974f9c9]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260]
Nov 28 18:38:36 user nova-compute[75203]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058, portal: 172.16.0.220,3260] successful.
Nov 28 18:38:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17d8fca9-e25f-4caf-8b8d-7130e4dd7058 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce7e412-559e-4515-a8d3-7265cd6e2948]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] <== disconnect_volume: return (452ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:38:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Deleting instance files /opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957_del
Nov 28 18:38:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Deletion of /opt/stack/data/nova/instances/16c72606-ed4c-4c7a-8295-a76da36da957_del complete
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: INFO nova.compute.manager [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Took 4.02 seconds to destroy the instance on the hypervisor.
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk 1073741824" returned: 0 in 0.056s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.201s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Cannot resize image /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Ensure instance console log exists: /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Successfully created port: a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:38:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Instance destroyed successfully.
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.objects.instance [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lazy-loading 'resources' on Instance uuid 72f841aa-13fb-4373-9225-2df8a700e045 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1847674091',display_name='tempest-TestVolumeSwap-server-1847674091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1847674091',id=7,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyQ+FGzOY5xMvUdQHIWytCdf3TsESC9qLeo+LivEIFB5dE23Smc6nuQdB12nFdvw9/E6QU1UGLLCzjJlxFeYeWWKLvVOiXFP8MQVrNpRIYaR522IvwC22nTQ0seBiTs5Q==',key_name='tempest-keypair-1525821321',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0590833de314f11b36a7cb7c5b23635',ramdisk_id='',reservation_id='r-h4wye505',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1702754877',owner_user_name='tempest-TestVolumeSwap-1702754877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc96b524e90a410f9a65b45d5bde199b',uuid=72f841aa-13fb-4373-9225-2df8a700e045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Converting VIF {"id": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "address": "fa:16:3e:39:a4:8d", "network": {"id": "2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1172649100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0590833de314f11b36a7cb7c5b23635", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f83989-3a", "ovs_interfaceid": "d9f83989-3a77-4ca2-90bf-d6485e6999a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:a4:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9f83989-3a77-4ca2-90bf-d6485e6999a9,network=Network(2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f83989-3a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG os_vif [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:a4:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9f83989-3a77-4ca2-90bf-d6485e6999a9,network=Network(2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f83989-3a') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9f83989-3a, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5f64251-56f8-4a74-a3d7-1e54825bdfd7) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:37 user nova-compute[75203]: INFO os_vif [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:a4:8d,bridge_name='br-int',has_traffic_filtering=True,id=d9f83989-3a77-4ca2-90bf-d6485e6999a9,network=Network(2bc9060b-2ba0-4c1f-a9e6-468dcd5c4930),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f83989-3a')
Nov 28 18:38:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Deleting instance files /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045_del
Nov 28 18:38:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Deletion of /opt/stack/data/nova/instances/72f841aa-13fb-4373-9225-2df8a700e045_del complete
Nov 28 18:38:37 user nova-compute[75203]: INFO nova.compute.manager [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Successfully updated port: a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquired lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-vif-unplugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] No waiting events found dispatching network-vif-unplugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-vif-unplugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Acquiring lock "72f841aa-13fb-4373-9225-2df8a700e045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Lock "72f841aa-13fb-4373-9225-2df8a700e045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] No waiting events found dispatching network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:38 user nova-compute[75203]: WARNING nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received unexpected event network-vif-plugged-d9f83989-3a77-4ca2-90bf-d6485e6999a9 for instance with vm_state active and task_state deleting.
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-changed-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Refreshing instance network info cache due to event network-changed-a7fb7677-2bdc-4383-88b0-ba6caecb778a. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Acquiring lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updating instance_info_cache with network_info: [{"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Releasing lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance network_info: |[{"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Acquired lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Refreshing network info cache for port a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Start _get_guest_xml network_info=[{"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:38:38 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:38 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-883710891',display_name='tempest-tempest.common.compute-instance-883710891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-883710891',id=15,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxCc6vEhlAeiMgyKG6RNZ45Sr0UQX//i1sndSdsS4E5kd+SCD4AsLEHMeWVxO7Y//0/zPvjjBK6YosabO12NQfr0oUb4HQ9Yrce4dAJs7I43Ckntfds0dUck6EybhVqjA==',key_name='tempest-keypair-839735458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-3rnm27ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=43538aa1-3ebe-4098-bd42-78353ed457ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.objects.instance [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'pci_devices' on Instance uuid 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:38:38 user nova-compute[75203]:   <uuid>43538aa1-3ebe-4098-bd42-78353ed457ce</uuid>
Nov 28 18:38:38 user nova-compute[75203]:   <name>instance-0000000f</name>
Nov 28 18:38:38 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:38:38 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:38:38 user nova-compute[75203]:   <metadata>
Nov 28 18:38:38 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:38:38 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:38:38 user nova-compute[75203]:       <nova:name>tempest-tempest.common.compute-instance-883710891</nova:name>
Nov 28 18:38:38 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:38:38</nova:creationTime>
Nov 28 18:38:38 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:38:38 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:38:38 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:38:38 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:38:38 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:38:38 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:38:38 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:38:38 user nova-compute[75203]:       <nova:owner>
Nov 28 18:38:38 user nova-compute[75203]:         <nova:user uuid="4b7ea4623ff14b2ea244c31ac84dd600">tempest-ServerActionsTestOtherA-1893596751-project-member</nova:user>
Nov 28 18:38:38 user nova-compute[75203]:         <nova:project uuid="974923cb2e06473bbd8e4122888494df">tempest-ServerActionsTestOtherA-1893596751</nova:project>
Nov 28 18:38:38 user nova-compute[75203]:       </nova:owner>
Nov 28 18:38:38 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:38:38 user nova-compute[75203]:       <nova:ports>
Nov 28 18:38:38 user nova-compute[75203]:         <nova:port uuid="a7fb7677-2bdc-4383-88b0-ba6caecb778a">
Nov 28 18:38:38 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:38:38 user nova-compute[75203]:         </nova:port>
Nov 28 18:38:38 user nova-compute[75203]:       </nova:ports>
Nov 28 18:38:38 user nova-compute[75203]:     </nova:instance>
Nov 28 18:38:38 user nova-compute[75203]:   </metadata>
Nov 28 18:38:38 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:38:38 user nova-compute[75203]:     <system>
Nov 28 18:38:38 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:38:38 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:38:38 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:38:38 user nova-compute[75203]:       <entry name="serial">43538aa1-3ebe-4098-bd42-78353ed457ce</entry>
Nov 28 18:38:38 user nova-compute[75203]:       <entry name="uuid">43538aa1-3ebe-4098-bd42-78353ed457ce</entry>
Nov 28 18:38:38 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:38:38 user nova-compute[75203]:     </system>
Nov 28 18:38:38 user nova-compute[75203]:   </sysinfo>
Nov 28 18:38:38 user nova-compute[75203]:   <os>
Nov 28 18:38:38 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:38:38 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:38:38 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:38:38 user nova-compute[75203]:   </os>
Nov 28 18:38:38 user nova-compute[75203]:   <features>
Nov 28 18:38:38 user nova-compute[75203]:     <acpi/>
Nov 28 18:38:38 user nova-compute[75203]:     <apic/>
Nov 28 18:38:38 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:38:38 user nova-compute[75203]:   </features>
Nov 28 18:38:38 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:38:38 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:38:38 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:38:38 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:38:38 user nova-compute[75203]:   </clock>
Nov 28 18:38:38 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:38:38 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:38:38 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:38:38 user nova-compute[75203]:   </cpu>
Nov 28 18:38:38 user nova-compute[75203]:   <devices>
Nov 28 18:38:38 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:38:38 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:38:38 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk"/>
Nov 28 18:38:38 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:38:38 user nova-compute[75203]:     </disk>
Nov 28 18:38:38 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:38:38 user nova-compute[75203]:       <mac address="fa:16:3e:1a:23:1d"/>
Nov 28 18:38:38 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:38 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:38:38 user nova-compute[75203]:       <target dev="tapa7fb7677-2b"/>
Nov 28 18:38:38 user nova-compute[75203]:     </interface>
Nov 28 18:38:38 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:38:38 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/console.log" append="off"/>
Nov 28 18:38:38 user nova-compute[75203]:     </serial>
Nov 28 18:38:38 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:38:38 user nova-compute[75203]:     <video>
Nov 28 18:38:38 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:38 user nova-compute[75203]:     </video>
Nov 28 18:38:38 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:38:38 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:38:38 user nova-compute[75203]:     </rng>
Nov 28 18:38:38 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:38:38 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:38:38 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:38:38 user nova-compute[75203]:     </memballoon>
Nov 28 18:38:38 user nova-compute[75203]:   </devices>
Nov 28 18:38:38 user nova-compute[75203]: </domain>
Nov 28 18:38:38 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-883710891',display_name='tempest-tempest.common.compute-instance-883710891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-883710891',id=15,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxCc6vEhlAeiMgyKG6RNZ45Sr0UQX//i1sndSdsS4E5kd+SCD4AsLEHMeWVxO7Y//0/zPvjjBK6YosabO12NQfr0oUb4HQ9Yrce4dAJs7I43Ckntfds0dUck6EybhVqjA==',key_name='tempest-keypair-839735458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-3rnm27ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=43538aa1-3ebe-4098-bd42-78353ed457ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG os_vif [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2b88069-befb-59c5-8a3a-05d6fc0efe16', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7fb7677-2b, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7fb7677-2b, col_values=(('qos', UUID('794449c5-68bd-4df9-a042-67336565d841')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7fb7677-2b, col_values=(('external_ids', {'iface-id': 'a7fb7677-2bdc-4383-88b0-ba6caecb778a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:23:1d', 'vm-uuid': '43538aa1-3ebe-4098-bd42-78353ed457ce'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:38 user nova-compute[75203]: INFO os_vif [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b')
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:38:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No VIF found with MAC fa:16:3e:1a:23:1d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:38:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updated VIF entry in instance network info cache for port a7fb7677-2bdc-4383-88b0-ba6caecb778a. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:38:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updating instance_info_cache with network_info: [{"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-39d8aa45-6fd1-4557-8d25-5bdec7e00f16 req-f593d553-3181-42c7-a6f4-d4e68b1dc317 service nova] Releasing lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:39 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:39 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Took 1.81 seconds to deallocate network for instance.
Nov 28 18:38:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-5f36600d-e988-4cc9-9788-971e3ba08138 req-174af4a5-333a-4938-bf91-a97402b57788 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Received event network-vif-deleted-d9f83989-3a77-4ca2-90bf-d6485e6999a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:39 user nova-compute[75203]: INFO nova.compute.manager [req-5f36600d-e988-4cc9-9788-971e3ba08138 req-174af4a5-333a-4938-bf91-a97402b57788 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Neutron deleted interface d9f83989-3a77-4ca2-90bf-d6485e6999a9; detaching it from the instance and deleting it from the info cache
Nov 28 18:38:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-5f36600d-e988-4cc9-9788-971e3ba08138 req-174af4a5-333a-4938-bf91-a97402b57788 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-5f36600d-e988-4cc9-9788-971e3ba08138 req-174af4a5-333a-4938-bf91-a97402b57788 service nova] [instance: 72f841aa-13fb-4373-9225-2df8a700e045] Detach interface failed, port_id=d9f83989-3a77-4ca2-90bf-d6485e6999a9, reason: Instance 72f841aa-13fb-4373-9225-2df8a700e045 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:38:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:40 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Deleted allocations for instance 72f841aa-13fb-4373-9225-2df8a700e045
Nov 28 18:38:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-600e0cfb-cf45-4171-9422-7a38cf9025f3 tempest-TestVolumeSwap-1702754877 tempest-TestVolumeSwap-1702754877-project-member] Lock "72f841aa-13fb-4373-9225-2df8a700e045" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.440s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:40 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-deleted-7c28d389-5c32-435b-8ca5-2d6ecfaf03a2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:41 user nova-compute[75203]: INFO nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Neutron deleted interface 7c28d389-5c32-435b-8ca5-2d6ecfaf03a2; detaching it from the instance and deleting it from the info cache
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "194b8b2c-3e49-4713-983b-255bddb7c462", "address": "fa:16:3e:be:4e:67", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194b8b2c-3e", "ovs_interfaceid": "194b8b2c-3e49-4713-983b-255bddb7c462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Detach interface failed, port_id=7c28d389-5c32-435b-8ca5-2d6ecfaf03a2, reason: Instance 16c72606-ed4c-4c7a-8295-a76da36da957 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-deleted-194b8b2c-3e49-4713-983b-255bddb7c462 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:41 user nova-compute[75203]: INFO nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Neutron deleted interface 194b8b2c-3e49-4713-983b-255bddb7c462; detaching it from the instance and deleting it from the info cache
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [{"id": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "address": "fa:16:3e:39:a6:56", "network": {"id": "d75fd7cf-22c0-4e71-bfe1-899659f543a5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-162233913-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8bae68-10", "ovs_interfaceid": "9d8bae68-1062-4edb-b1b3-27ff8b55b225", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "address": "fa:16:3e:08:6f:0b", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd28852c4-ae", "ovs_interfaceid": "d28852c4-aebd-4cc2-af45-f02e6b6226b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "986fa26d-73d2-4879-9213-2adb023290d8", "address": "fa:16:3e:37:38:ab", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fa26d-73", "ovs_interfaceid": "986fa26d-73d2-4879-9213-2adb023290d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "address": "fa:16:3e:b4:80:51", "network": {"id": "8bfe1bc1-4d80-4dcb-9a6a-a68ed1d30192", "bridge": "br-int", "label": "tempest-device-tagging-net1-1868138365", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4c741b-1d", "ovs_interfaceid": "5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e2db7ae-c549-4368-852e-68494ac2f978", "address": "fa:16:3e:32:e7:01", "network": {"id": "c7534016-22cd-482b-91e7-854be8b13c86", "bridge": "br-int", "label": "tempest-device-tagging-net2-1675732915", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "730532d801394235950dc0a30cf94733", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e2db7ae-c5", "ovs_interfaceid": "8e2db7ae-c549-4368-852e-68494ac2f978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Detach interface failed, port_id=194b8b2c-3e49-4713-983b-255bddb7c462, reason: Instance 16c72606-ed4c-4c7a-8295-a76da36da957 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:41 user nova-compute[75203]: WARNING nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received unexpected event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with vm_state building and task_state spawning.
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:41 user nova-compute[75203]: WARNING nova.compute.manager [req-e86385be-91f7-46d8-8299-384a8e8d2b91 req-6d019fdd-cbfe-4327-9929-cc894d3b692f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received unexpected event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with vm_state building and task_state spawning.
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:38:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:43 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Took 5.98 seconds to deallocate network for instance.
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'pci_requests' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'numa_topology' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:38:43 user nova-compute[75203]: INFO nova.compute.claims [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Claim successful on node user
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance spawned successfully.
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:43 user nova-compute[75203]: INFO nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:43 user nova-compute[75203]: INFO nova.compute.manager [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Took 8.15 seconds to build instance.
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-95a5b532-ebd1-4642-b0a0-d1146b0c3ada tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.507s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-51f795c1-6ed4-49cf-b8b9-a4d474890cdf req-7b247880-6656-44bf-a3ac-a04588ebac87 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-deleted-9d8bae68-1062-4edb-b1b3-27ff8b55b225 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-51f795c1-6ed4-49cf-b8b9-a4d474890cdf req-7b247880-6656-44bf-a3ac-a04588ebac87 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-deleted-5b4c741b-1d80-4f7d-80e9-3ecdf0ae6ce8 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-51f795c1-6ed4-49cf-b8b9-a4d474890cdf req-7b247880-6656-44bf-a3ac-a04588ebac87 service nova] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Received event network-vif-deleted-8e2db7ae-c549-4368-852e-68494ac2f978 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.817s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:44 user nova-compute[75203]: INFO nova.network.neutron [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating port e926ef4f-c658-45e4-9a84-0368130c6bcb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquired lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG nova.network.neutron [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:38:45 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:45 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7617MB free_disk=25.366134643554688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 16c72606-ed4c-4c7a-8295-a76da36da957 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance eec19476-5b8e-4d91-b0e3-6ecd0986632d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 1c277046-cdb1-4499-b8d2-8c18d9913dd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (124a0dbb-54e7-4217-a850-c2ea3ab9818b): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43538aa1-3ebe-4098-bd42-78353ed457ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Releasing lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:38:45 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Creating image(s)
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.objects.instance [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.objects.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<55c0f8b3-b64d-43d0-9245-730ee9f836fb> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "10c1f6a0e9671baf558e1c91ea55fa4546e6a487" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "10c1f6a0e9671baf558e1c91ea55fa4546e6a487" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-changed-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Refreshing instance network info cache due to event network-changed-e926ef4f-c658-45e4-9a84-0368130c6bcb. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] Acquiring lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] Acquired lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:45 user nova-compute[75203]: DEBUG nova.network.neutron [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Refreshing network info cache for port e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:38:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:46 user nova-compute[75203]: INFO nova.compute.manager [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] [instance: 16c72606-ed4c-4c7a-8295-a76da36da957] Took 3.79 seconds to detach 3 volumes for instance.
Nov 28 18:38:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.virt.images [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] bac2f97d-df05-4d96-be2d-968f48be8d7b was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.part /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.739s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.213s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.part /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.converted" returned: 0 in 0.328s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.network.neutron [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updated VIF entry in instance network info cache for port e926ef4f-c658-45e4-9a84-0368130c6bcb. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.network.neutron [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d48082b3-ea47-4938-a2e2-9c35bb8843e9 req-778197c7-20cc-403f-b0e4-f3bb6ed304f1 service nova] Releasing lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "10c1f6a0e9671baf558e1c91ea55fa4546e6a487" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.868s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487 --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "10c1f6a0e9671baf558e1c91ea55fa4546e6a487" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "10c1f6a0e9671baf558e1c91ea55fa4546e6a487" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:47 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Deleted allocations for instance 16c72606-ed4c-4c7a-8295-a76da36da957
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d190d9d-0d6c-4b77-b85a-2f0ed166ae6c tempest-TaggedBootDevicesTest-1004375661 tempest-TaggedBootDevicesTest-1004375661-project-member] Lock "16c72606-ed4c-4c7a-8295-a76da36da957" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.851s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487 --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487,backing_fmt=raw /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487,backing_fmt=raw /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk 1073741824" returned: 0 in 0.056s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "10c1f6a0e9671baf558e1c91ea55fa4546e6a487" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487 --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG nova.objects.instance [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'migration_context' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG nova.objects.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<55c0f8b3-b64d-43d0-9245-730ee9f836fb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:38:48 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Rebasing disk image.
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.208s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b -F raw /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-55c0f8b3-b64d-43d0-9245-730ee9f836fb" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:38:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:38:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b -F raw /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk" returned: 0 in 2.505s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:38:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Ensure instance console log exists: /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:38:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Start _get_guest_xml network_info=[{"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e8b3d08f05939b2ac3b7b6866e1f6568',container_format='bare',created_at=2023-11-28T18:36:41Z,direct_url=<?>,disk_format='qcow2',id=bac2f97d-df05-4d96-be2d-968f48be8d7b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-872100218-shelved',owner='39b4d281e6da4779a68b17ecd896e6a2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T18:36:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbysfJdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '55c0f8b3-b64d-43d0-9245-730ee9f836fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2', 'serial': 'b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'a9265f9a-e8b3-4137-87c7-42e592d9bb7c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:38:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e8b3d08f05939b2ac3b7b6866e1f6568',container_format='bare',created_at=2023-11-28T18:36:41Z,direct_url=<?>,disk_format='qcow2',id=bac2f97d-df05-4d96-be2d-968f48be8d7b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-872100218-shelved',owner='39b4d281e6da4779a68b17ecd896e6a2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T18:36:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.objects.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<55c0f8b3-b64d-43d0-9245-730ee9f836fb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbysfJdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:38:51 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:38:51 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:38:51 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb01d20-cfd6-43e6-b1c7-cd53de4ac127]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:38:51 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[659fbf6f-346c-4830-a6a2-802c16928e62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2] added
Nov 28 18:38:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff44b1-fde6-488d-a8af-280422613c34]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b8a010-a1e4-4b52-95c2-87a2bc57a87d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbysfJdh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gbysfJdh" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[809fa407-ef84-47f8-b953-0c27db5fe894]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gbysfJdh'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ce654d-c612-436f-a03b-fc8ebab279a1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8f165e-7c05-4d77-b59b-120f4011876d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:51 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:51 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a88259-7bd3-4e40-8247-c5f5bde456e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260]
Nov 28 18:38:51 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260] successful.
Nov 28 18:38:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b2c815-eb4f-4889-a82b-911cd9087515]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77c1087-02fa-4069-a422-6096705aac41]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:51 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:51 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:38:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:38:51 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:38:51 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:38:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c954cf4-b053-4b41-8d1e-80adf943510b]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:38:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbysfJdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26464663137373731', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464663137373731', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-872100218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-872100218',id=4,image_ref='bac2f97d-df05-4d96-be2d-968f48be8d7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1052442870',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-bvmbn55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member',shelved_at='2023-11-28T18:36:45.972327',shelved_host='user',shelved_image_id='bac2f97d-df05-4d96-be2d-968f48be8d7b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=55c0f8b3-b64d-43d0-9245-730ee9f836fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'pci_devices' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<55c0f8b3-b64d-43d0-9245-730ee9f836fb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:38:52 user nova-compute[75203]:   <uuid>55c0f8b3-b64d-43d0-9245-730ee9f836fb</uuid>
Nov 28 18:38:52 user nova-compute[75203]:   <name>instance-00000004</name>
Nov 28 18:38:52 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:38:52 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:38:52 user nova-compute[75203]:   <metadata>
Nov 28 18:38:52 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:38:52 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:38:52 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-872100218</nova:name>
Nov 28 18:38:52 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:38:50</nova:creationTime>
Nov 28 18:38:52 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:38:52 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:38:52 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:38:52 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:38:52 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:38:52 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:38:52 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:38:52 user nova-compute[75203]:       <nova:owner>
Nov 28 18:38:52 user nova-compute[75203]:         <nova:user uuid="c1a7cdac05464b9ca3ef185aafe6ea0d">tempest-AttachVolumeShelveTestJSON-1995055501-project-member</nova:user>
Nov 28 18:38:52 user nova-compute[75203]:         <nova:project uuid="39b4d281e6da4779a68b17ecd896e6a2">tempest-AttachVolumeShelveTestJSON-1995055501</nova:project>
Nov 28 18:38:52 user nova-compute[75203]:       </nova:owner>
Nov 28 18:38:52 user nova-compute[75203]:       <nova:root type="image" uuid="bac2f97d-df05-4d96-be2d-968f48be8d7b"/>
Nov 28 18:38:52 user nova-compute[75203]:       <nova:ports>
Nov 28 18:38:52 user nova-compute[75203]:         <nova:port uuid="e926ef4f-c658-45e4-9a84-0368130c6bcb">
Nov 28 18:38:52 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 18:38:52 user nova-compute[75203]:         </nova:port>
Nov 28 18:38:52 user nova-compute[75203]:       </nova:ports>
Nov 28 18:38:52 user nova-compute[75203]:     </nova:instance>
Nov 28 18:38:52 user nova-compute[75203]:   </metadata>
Nov 28 18:38:52 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:38:52 user nova-compute[75203]:     <system>
Nov 28 18:38:52 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:38:52 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:38:52 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:38:52 user nova-compute[75203]:       <entry name="serial">55c0f8b3-b64d-43d0-9245-730ee9f836fb</entry>
Nov 28 18:38:52 user nova-compute[75203]:       <entry name="uuid">55c0f8b3-b64d-43d0-9245-730ee9f836fb</entry>
Nov 28 18:38:52 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:38:52 user nova-compute[75203]:     </system>
Nov 28 18:38:52 user nova-compute[75203]:   </sysinfo>
Nov 28 18:38:52 user nova-compute[75203]:   <os>
Nov 28 18:38:52 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:38:52 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:38:52 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:38:52 user nova-compute[75203]:   </os>
Nov 28 18:38:52 user nova-compute[75203]:   <features>
Nov 28 18:38:52 user nova-compute[75203]:     <acpi/>
Nov 28 18:38:52 user nova-compute[75203]:     <apic/>
Nov 28 18:38:52 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:38:52 user nova-compute[75203]:   </features>
Nov 28 18:38:52 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:38:52 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:38:52 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:38:52 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:38:52 user nova-compute[75203]:   </clock>
Nov 28 18:38:52 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:38:52 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:38:52 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:38:52 user nova-compute[75203]:   </cpu>
Nov 28 18:38:52 user nova-compute[75203]:   <devices>
Nov 28 18:38:52 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:38:52 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:38:52 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk"/>
Nov 28 18:38:52 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:38:52 user nova-compute[75203]:     </disk>
Nov 28 18:38:52 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:38:52 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:38:52 user nova-compute[75203]:       <source dev="/dev/sdc"/>
Nov 28 18:38:52 user nova-compute[75203]:       <target dev="vdc" bus="virtio"/>
Nov 28 18:38:52 user nova-compute[75203]:       <serial>b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2</serial>
Nov 28 18:38:52 user nova-compute[75203]:     </disk>
Nov 28 18:38:52 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:38:52 user nova-compute[75203]:       <mac address="fa:16:3e:c0:7c:67"/>
Nov 28 18:38:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:52 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:38:52 user nova-compute[75203]:       <target dev="tape926ef4f-c6"/>
Nov 28 18:38:52 user nova-compute[75203]:     </interface>
Nov 28 18:38:52 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:38:52 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/console.log" append="off"/>
Nov 28 18:38:52 user nova-compute[75203]:     </serial>
Nov 28 18:38:52 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:38:52 user nova-compute[75203]:     <video>
Nov 28 18:38:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:38:52 user nova-compute[75203]:     </video>
Nov 28 18:38:52 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:38:52 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:38:52 user nova-compute[75203]:     </rng>
Nov 28 18:38:52 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:38:52 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:38:52 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:38:52 user nova-compute[75203]:     </memballoon>
Nov 28 18:38:52 user nova-compute[75203]:   </devices>
Nov 28 18:38:52 user nova-compute[75203]: </domain>
Nov 28 18:38:52 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-872100218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-872100218',id=4,image_ref='bac2f97d-df05-4d96-be2d-968f48be8d7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1052442870',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-bvmbn55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member',shelved_at='2023-11-28T18:36:45.972327',shelved_host='user',shelved_image_id='bac2f97d-df05-4d96-be2d-968f48be8d7b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=55c0f8b3-b64d-43d0-9245-730ee9f836fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG os_vif [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb4f5595-3e10-5db9-9d62-f068a81159ae', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape926ef4f-c6, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape926ef4f-c6, col_values=(('qos', UUID('ab5e6c7a-a197-4c09-aa13-25bd7b156b2a')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape926ef4f-c6, col_values=(('external_ids', {'iface-id': 'e926ef4f-c658-45e4-9a84-0368130c6bcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:7c:67', 'vm-uuid': '55c0f8b3-b64d-43d0-9245-730ee9f836fb'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:52 user nova-compute[75203]: INFO os_vif [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6')
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:38:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No VIF found with MAC fa:16:3e:c0:7c:67, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-4fb26dc5-9eaa-4cbd-80d2-4512e128af5e req-dbf56d2b-3e56-4b6e-a85c-104ecb40230f service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fb26dc5-9eaa-4cbd-80d2-4512e128af5e req-dbf56d2b-3e56-4b6e-a85c-104ecb40230f service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fb26dc5-9eaa-4cbd-80d2-4512e128af5e req-dbf56d2b-3e56-4b6e-a85c-104ecb40230f service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fb26dc5-9eaa-4cbd-80d2-4512e128af5e req-dbf56d2b-3e56-4b6e-a85c-104ecb40230f service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-4fb26dc5-9eaa-4cbd-80d2-4512e128af5e req-dbf56d2b-3e56-4b6e-a85c-104ecb40230f service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:54 user nova-compute[75203]: WARNING nova.compute.manager [req-4fb26dc5-9eaa-4cbd-80d2-4512e128af5e req-dbf56d2b-3e56-4b6e-a85c-104ecb40230f service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received unexpected event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 18:38:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-99d73ed8-81da-4846-bf09-48c0278f989e req-20c0d7ca-a645-4bf3-844b-f3bffb30693c service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:38:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-99d73ed8-81da-4846-bf09-48c0278f989e req-20c0d7ca-a645-4bf3-844b-f3bffb30693c service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:38:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-99d73ed8-81da-4846-bf09-48c0278f989e req-20c0d7ca-a645-4bf3-844b-f3bffb30693c service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:38:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-99d73ed8-81da-4846-bf09-48c0278f989e req-20c0d7ca-a645-4bf3-844b-f3bffb30693c service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-99d73ed8-81da-4846-bf09-48c0278f989e req-20c0d7ca-a645-4bf3-844b-f3bffb30693c service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:38:56 user nova-compute[75203]: WARNING nova.compute.manager [req-99d73ed8-81da-4846-bf09-48c0278f989e req-20c0d7ca-a645-4bf3-844b-f3bffb30693c service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received unexpected event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 18:38:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:38:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:38:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance spawned successfully.
Nov 28 18:38:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:38:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-26e47267-8c81-482c-9541-3e1d75d27976 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.275s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:38:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:38:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:07 user nova-compute[75203]: INFO nova.compute.manager [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Terminating instance
Nov 28 18:39:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-fca11f19-7aa2-4679-81b6-612c9a5e56b0 req-da3c2b11-19f1-4653-af48-27ab6775dff9 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-unplugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fca11f19-7aa2-4679-81b6-612c9a5e56b0 req-da3c2b11-19f1-4653-af48-27ab6775dff9 service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fca11f19-7aa2-4679-81b6-612c9a5e56b0 req-da3c2b11-19f1-4653-af48-27ab6775dff9 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fca11f19-7aa2-4679-81b6-612c9a5e56b0 req-da3c2b11-19f1-4653-af48-27ab6775dff9 service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-fca11f19-7aa2-4679-81b6-612c9a5e56b0 req-da3c2b11-19f1-4653-af48-27ab6775dff9 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-unplugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-fca11f19-7aa2-4679-81b6-612c9a5e56b0 req-da3c2b11-19f1-4653-af48-27ab6775dff9 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-unplugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:39:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:08 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Instance destroyed successfully.
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lazy-loading 'resources' on Instance uuid b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:35:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-129040155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540435995',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6oL/7vvy9taX59bYI1WkM2HscWCZsFVsysC1exh/0Cmaz5gesQgSdKJwRW00bX89IFpRG0IkpITdH7sGiUa2XGjjHsEJIxVsYERrNHqSdOkmfTf8b+AU/z+Ywzde3ffQ==',key_name='tempest-keypair-1295110036',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:38:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93335bb18c124da8b9eb12111d71ff4f',ramdisk_id='',reservation_id='r-1occtchr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647964474',owner_user_name='tempest-ServerActionsV293TestJSON-647964474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc933353e4e643ea86c6dfb0337302b1',uuid=b8e8fdb2-f3a6-45dc-96d2-b9703922ef10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converting VIF {"id": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "address": "fa:16:3e:73:e0:37", "network": {"id": "8ba612ca-3040-43fa-8129-7ae37cf76b79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1848469708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93335bb18c124da8b9eb12111d71ff4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap547b5c17-1d", "ovs_interfaceid": "547b5c17-1da6-4e8e-92fa-4edd0aabcdad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_vif [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap547b5c17-1d, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cae27cba-c7b6-4fcc-928c-c05ffce63964) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:39:08 user nova-compute[75203]: INFO os_vif [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad,network=Network(8ba612ca-3040-43fa-8129-7ae37cf76b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap547b5c17-1d')
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbWXnoiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:39:08 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5b1fed-5af6-4a1a-8b73-ef216b109997]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:39:08 user nova-compute[75203]: No targets found.
Nov 28 18:39:08 user nova-compute[75203]: iSNS:
Nov 28 18:39:08 user nova-compute[75203]: No targets found.
Nov 28 18:39:08 user nova-compute[75203]: STATIC:
Nov 28 18:39:08 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8
Nov 28 18:39:08 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:39:08 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:39:08 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2
Nov 28 18:39:08 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:39:08 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:39:08 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:39:08 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:39:08 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:39:08 user nova-compute[75203]: FIRMWARE:
Nov 28 18:39:08 user nova-compute[75203]: No targets found.
Nov 28 18:39:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:39:08 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:39:08 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[80089976-cf3f-407b-9f15-7433c2fdbfa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed0dbb-5fe1-49e0-bb0d-39711c28948f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:39:08 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:39:08 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:39:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 (non-flash)
Nov 28 18:39:08 user nova-compute[75203]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:39:08 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:39:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903f7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c491f9-4a6a-40dd-9390-1c1f57818580]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d948493-6adc-45f3-b900-65ef71926857]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aa041d-f959-4c96-a0da-ede88079a6aa]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0441c9-63c1-4c49-a7ce-5ff0e2192d33]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfcfa46-b624-4ce9-82e8-1114b76f53de]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340a537-0200-4696-bd76-3fe8ec2104e1]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260]
Nov 28 18:39:08 user nova-compute[75203]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8, portal: 172.16.0.220,3260] successful.
Nov 28 18:39:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23656aa-1c65-4997-903d-224fd33cac58]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] <== disconnect_volume: return (375ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:39:08 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Deleting instance files /opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10_del
Nov 28 18:39:08 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Deletion of /opt/stack/data/nova/instances/b8e8fdb2-f3a6-45dc-96d2-b9703922ef10_del complete
Nov 28 18:39:08 user nova-compute[75203]: INFO nova.compute.manager [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 28 18:39:08 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:39:08 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:39:09 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:09 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Took 1.08 seconds to deallocate network for instance.
Nov 28 18:39:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-c36a55b6-b3d4-44bb-9e38-68dbe1469aa8 req-02c3c508-f4d6-41a9-a880-e79e0d0345b6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-deleted-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:09 user nova-compute[75203]: INFO nova.compute.manager [req-c36a55b6-b3d4-44bb-9e38-68dbe1469aa8 req-02c3c508-f4d6-41a9-a880-e79e0d0345b6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Neutron deleted interface 547b5c17-1da6-4e8e-92fa-4edd0aabcdad; detaching it from the instance and deleting it from the info cache
Nov 28 18:39:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-c36a55b6-b3d4-44bb-9e38-68dbe1469aa8 req-02c3c508-f4d6-41a9-a880-e79e0d0345b6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-c36a55b6-b3d4-44bb-9e38-68dbe1469aa8 req-02c3c508-f4d6-41a9-a880-e79e0d0345b6 service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Detach interface failed, port_id=547b5c17-1da6-4e8e-92fa-4edd0aabcdad, reason: Instance b8e8fdb2-f3a6-45dc-96d2-b9703922ef10 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:39:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-80948d61-225e-40bd-bf2a-07d48eda6163 req-e3ddf7e0-77e3-481e-8803-448b971fd2da service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-80948d61-225e-40bd-bf2a-07d48eda6163 req-e3ddf7e0-77e3-481e-8803-448b971fd2da service nova] Acquiring lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-80948d61-225e-40bd-bf2a-07d48eda6163 req-e3ddf7e0-77e3-481e-8803-448b971fd2da service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-80948d61-225e-40bd-bf2a-07d48eda6163 req-e3ddf7e0-77e3-481e-8803-448b971fd2da service nova] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-80948d61-225e-40bd-bf2a-07d48eda6163 req-e3ddf7e0-77e3-481e-8803-448b971fd2da service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] No waiting events found dispatching network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:09 user nova-compute[75203]: WARNING nova.compute.manager [req-80948d61-225e-40bd-bf2a-07d48eda6163 req-e3ddf7e0-77e3-481e-8803-448b971fd2da service nova] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Received unexpected event network-vif-plugged-547b5c17-1da6-4e8e-92fa-4edd0aabcdad for instance with vm_state active and task_state deleting.
Nov 28 18:39:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:10 user nova-compute[75203]: INFO nova.compute.manager [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Took 1.19 seconds to detach 1 volumes for instance.
Nov 28 18:39:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] [instance: b8e8fdb2-f3a6-45dc-96d2-b9703922ef10] Deleting volume: ba0cdd0a-0bb5-4030-a56c-661bfe9c0af8 {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 18:39:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:11 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:39:11 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:39:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:11 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Deleted allocations for instance b8e8fdb2-f3a6-45dc-96d2-b9703922ef10
Nov 28 18:39:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4cf701e7-b1a6-479f-b6e4-9530176013f4 tempest-ServerActionsV293TestJSON-647964474 tempest-ServerActionsV293TestJSON-647964474-project-member] Lock "b8e8fdb2-f3a6-45dc-96d2-b9703922ef10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.330s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:28 user nova-compute[75203]: INFO nova.compute.manager [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Rescuing
Nov 28 18:39:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:39:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:39:28 user nova-compute[75203]: DEBUG nova.network.neutron [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG nova.network.neutron [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:29 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance destroyed successfully.
Nov 28 18:39:29 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Attempting rescue
Nov 28 18:39:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75203) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:39:29 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Creating image(s)
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG nova.objects.instance [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'trusted_certs' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.214s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue" returned: 0 in 0.053s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.instance [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'migration_context' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.base [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<fafd72ff-f097-4605-b7d5-c4d68ca082dc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Start _get_guest_xml network_info=[{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:9f:e1:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.instance [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'resources' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.base [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<fafd72ff-f097-4605-b7d5-c4d68ca082dc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.instance [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'numa_topology' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.base [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<fafd72ff-f097-4605-b7d5-c4d68ca082dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:39:30 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:30 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.instance [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'vcpu_model' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.base [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<fafd72ff-f097-4605-b7d5-c4d68ca082dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-681958282',display_name='tempest-ServerRescueNegativeTestJSON-server-681958282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-681958282',id=2,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-6bb15uyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:35:04Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=fafd72ff-f097-4605-b7d5-c4d68ca082dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:9f:e1:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:9f:e1:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.instance [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'pci_devices' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.objects.base [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<fafd72ff-f097-4605-b7d5-c4d68ca082dc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:39:30 user nova-compute[75203]:   <uuid>fafd72ff-f097-4605-b7d5-c4d68ca082dc</uuid>
Nov 28 18:39:30 user nova-compute[75203]:   <name>instance-00000002</name>
Nov 28 18:39:30 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:39:30 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:39:30 user nova-compute[75203]:   <metadata>
Nov 28 18:39:30 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:39:30 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:39:30 user nova-compute[75203]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-681958282</nova:name>
Nov 28 18:39:30 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:39:30</nova:creationTime>
Nov 28 18:39:30 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:39:30 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:39:30 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:39:30 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:39:30 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:39:30 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:39:30 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:39:30 user nova-compute[75203]:       <nova:owner>
Nov 28 18:39:30 user nova-compute[75203]:         <nova:user uuid="f96761cb11ad45b0bbc9a0435d3c0324">tempest-ServerRescueNegativeTestJSON-2096861107-project-member</nova:user>
Nov 28 18:39:30 user nova-compute[75203]:         <nova:project uuid="13d19b759f9948c9be9be5097069099b">tempest-ServerRescueNegativeTestJSON-2096861107</nova:project>
Nov 28 18:39:30 user nova-compute[75203]:       </nova:owner>
Nov 28 18:39:30 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:39:30 user nova-compute[75203]:       <nova:ports>
Nov 28 18:39:30 user nova-compute[75203]:         <nova:port uuid="26a39e18-8e9a-4f09-93f5-bc59364ca68e">
Nov 28 18:39:30 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 18:39:30 user nova-compute[75203]:         </nova:port>
Nov 28 18:39:30 user nova-compute[75203]:       </nova:ports>
Nov 28 18:39:30 user nova-compute[75203]:     </nova:instance>
Nov 28 18:39:30 user nova-compute[75203]:   </metadata>
Nov 28 18:39:30 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:39:30 user nova-compute[75203]:     <system>
Nov 28 18:39:30 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:39:30 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:39:30 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:39:30 user nova-compute[75203]:       <entry name="serial">fafd72ff-f097-4605-b7d5-c4d68ca082dc</entry>
Nov 28 18:39:30 user nova-compute[75203]:       <entry name="uuid">fafd72ff-f097-4605-b7d5-c4d68ca082dc</entry>
Nov 28 18:39:30 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:39:30 user nova-compute[75203]:     </system>
Nov 28 18:39:30 user nova-compute[75203]:   </sysinfo>
Nov 28 18:39:30 user nova-compute[75203]:   <os>
Nov 28 18:39:30 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:39:30 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:39:30 user nova-compute[75203]:   </os>
Nov 28 18:39:30 user nova-compute[75203]:   <features>
Nov 28 18:39:30 user nova-compute[75203]:     <acpi/>
Nov 28 18:39:30 user nova-compute[75203]:     <apic/>
Nov 28 18:39:30 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:39:30 user nova-compute[75203]:   </features>
Nov 28 18:39:30 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:39:30 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:39:30 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:39:30 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:39:30 user nova-compute[75203]:   </clock>
Nov 28 18:39:30 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:39:30 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:39:30 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:39:30 user nova-compute[75203]:   </cpu>
Nov 28 18:39:30 user nova-compute[75203]:   <devices>
Nov 28 18:39:30 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:39:30 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:39:30 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue"/>
Nov 28 18:39:30 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:39:30 user nova-compute[75203]:     </disk>
Nov 28 18:39:30 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:39:30 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:39:30 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk"/>
Nov 28 18:39:30 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:39:30 user nova-compute[75203]:     </disk>
Nov 28 18:39:30 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:39:30 user nova-compute[75203]:       <mac address="fa:16:3e:9f:e1:f0"/>
Nov 28 18:39:30 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:39:30 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:39:30 user nova-compute[75203]:       <target dev="tap26a39e18-8e"/>
Nov 28 18:39:30 user nova-compute[75203]:     </interface>
Nov 28 18:39:30 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:39:30 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/console.log" append="off"/>
Nov 28 18:39:30 user nova-compute[75203]:     </serial>
Nov 28 18:39:30 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:39:30 user nova-compute[75203]:     <video>
Nov 28 18:39:30 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:39:30 user nova-compute[75203]:     </video>
Nov 28 18:39:30 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:39:30 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:39:30 user nova-compute[75203]:     </rng>
Nov 28 18:39:30 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:39:30 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:39:30 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:39:30 user nova-compute[75203]:     </memballoon>
Nov 28 18:39:30 user nova-compute[75203]:   </devices>
Nov 28 18:39:30 user nova-compute[75203]: </domain>
Nov 28 18:39:30 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:39:30 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance destroyed successfully.
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:39:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No VIF found with MAC fa:16:3e:9f:e1:f0, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-101f0a1f-eaa1-43b9-bdf0-3311fab4ca80 req-d77569be-04b0-4ee2-b546-fd3178d7dd62 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-101f0a1f-eaa1-43b9-bdf0-3311fab4ca80 req-d77569be-04b0-4ee2-b546-fd3178d7dd62 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-101f0a1f-eaa1-43b9-bdf0-3311fab4ca80 req-d77569be-04b0-4ee2-b546-fd3178d7dd62 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-101f0a1f-eaa1-43b9-bdf0-3311fab4ca80 req-d77569be-04b0-4ee2-b546-fd3178d7dd62 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-101f0a1f-eaa1-43b9-bdf0-3311fab4ca80 req-d77569be-04b0-4ee2-b546-fd3178d7dd62 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:31 user nova-compute[75203]: WARNING nova.compute.manager [req-101f0a1f-eaa1-43b9-bdf0-3311fab4ca80 req-d77569be-04b0-4ee2-b546-fd3178d7dd62 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state active and task_state rescuing.
Nov 28 18:39:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:33 user nova-compute[75203]: WARNING nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state active and task_state rescuing.
Nov 28 18:39:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:33 user nova-compute[75203]: WARNING nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state active and task_state rescuing.
Nov 28 18:39:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:33 user nova-compute[75203]: WARNING nova.compute.manager [req-0388b1ef-8da1-462c-ba2f-8bd16490a7cd req-ce3bb9ba-82b7-46b7-9b5e-ee417bc85638 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state active and task_state rescuing.
Nov 28 18:39:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-40d7bfdd-cf55-4074-9af6-e36c5a802a9c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:39:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:39:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:39:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:39:38 user nova-compute[75203]: INFO nova.compute.claims [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Claim successful on node user
Nov 28 18:39:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:39:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.policy [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be936df829fd467e9905758c55d5cb19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e94875ddb5214ab6868b5e1c8e2d808e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:39:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Creating image(s)
Nov 28 18:39:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "/opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "/opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "e71934900d5fe337ce08e757cf666adddd5bc61d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "e71934900d5fe337ce08e757cf666adddd5bc61d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG nova.virt.images [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] 679ccc27-04ab-4552-8dc0-be4b06daf258 was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.part /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Successfully created port: 96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.part /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.converted" returned: 0 in 0.322s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "e71934900d5fe337ce08e757cf666adddd5bc61d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.234s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "e71934900d5fe337ce08e757cf666adddd5bc61d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "e71934900d5fe337ce08e757cf666adddd5bc61d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d --force-share --output=json" returned: 0 in 0.205s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d,backing_fmt=raw /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d,backing_fmt=raw /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk 1073741824" returned: 0 in 0.050s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "e71934900d5fe337ce08e757cf666adddd5bc61d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d --force-share --output=json" returned: 0 in 0.210s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Cannot resize image /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Ensure instance console log exists: /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Successfully updated port: 96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquired lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-changed-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Refreshing instance network info cache due to event network-changed-96f2c936-b17c-4576-88e3-bceabf0d612b. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:39:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] Acquiring lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Updating instance_info_cache with network_info: [{"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Releasing lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Instance network_info: |[{"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] Acquired lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Refreshing network info cache for port 96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Start _get_guest_xml network_info=[{"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:39:34Z,direct_url=<?>,disk_format='qcow2',id=679ccc27-04ab-4552-8dc0-be4b06daf258,min_disk=0,min_ram=0,name='',owner='d963b8c07cf241f3924d9624898ac612',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:39:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'image_id': '679ccc27-04ab-4552-8dc0-be4b06daf258'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:42 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:42 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:39:34Z,direct_url=<?>,disk_format='qcow2',id=679ccc27-04ab-4552-8dc0-be4b06daf258,min_disk=0,min_ram=0,name='',owner='d963b8c07cf241f3924d9624898ac612',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:39:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-103806647',display_name='tempest-AttachSCSIVolumeTestJSON-server-103806647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-103806647',id=16,image_ref='679ccc27-04ab-4552-8dc0-be4b06daf258',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbWqCaByOWIC3Lp+ogJb9rMViXkQ6Wl58OGHo3Ip5VA6E8w4wILIZuFFAeLgFkwhyU6qfJZneeg62pLIv906vQfHnXdHlI7wB7H5qnN5kMhLWu3gwEpNAMjP9stFqwUjQ==',key_name='tempest-keypair-1357937852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94875ddb5214ab6868b5e1c8e2d808e',ramdisk_id='',reservation_id='r-dnm6aha6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='679ccc27-04ab-4552-8dc0-be4b06daf258',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-453690146',owner_user_name='tempest-AttachSCSIVolumeTestJSON-453690146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be936df829fd467e9905758c55d5cb19',uuid=1a74de08-00b4-4fde-b1df-0af9ab5001b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Converting VIF {"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bc:a0,bridge_name='br-int',has_traffic_filtering=True,id=96f2c936-b17c-4576-88e3-bceabf0d612b,network=Network(cf2d5c11-12bc-471b-b75a-c6f68db4e31f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2c936-b1') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.objects.instance [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a74de08-00b4-4fde-b1df-0af9ab5001b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:39:42 user nova-compute[75203]:   <uuid>1a74de08-00b4-4fde-b1df-0af9ab5001b0</uuid>
Nov 28 18:39:42 user nova-compute[75203]:   <name>instance-00000010</name>
Nov 28 18:39:42 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:39:42 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:39:42 user nova-compute[75203]:   <metadata>
Nov 28 18:39:42 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:39:42 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:39:42 user nova-compute[75203]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-103806647</nova:name>
Nov 28 18:39:42 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:39:42</nova:creationTime>
Nov 28 18:39:42 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:39:42 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:39:42 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:39:42 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:39:42 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:39:42 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:39:42 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:39:42 user nova-compute[75203]:       <nova:owner>
Nov 28 18:39:42 user nova-compute[75203]:         <nova:user uuid="be936df829fd467e9905758c55d5cb19">tempest-AttachSCSIVolumeTestJSON-453690146-project-member</nova:user>
Nov 28 18:39:42 user nova-compute[75203]:         <nova:project uuid="e94875ddb5214ab6868b5e1c8e2d808e">tempest-AttachSCSIVolumeTestJSON-453690146</nova:project>
Nov 28 18:39:42 user nova-compute[75203]:       </nova:owner>
Nov 28 18:39:42 user nova-compute[75203]:       <nova:root type="image" uuid="679ccc27-04ab-4552-8dc0-be4b06daf258"/>
Nov 28 18:39:42 user nova-compute[75203]:       <nova:ports>
Nov 28 18:39:42 user nova-compute[75203]:         <nova:port uuid="96f2c936-b17c-4576-88e3-bceabf0d612b">
Nov 28 18:39:42 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 18:39:42 user nova-compute[75203]:         </nova:port>
Nov 28 18:39:42 user nova-compute[75203]:       </nova:ports>
Nov 28 18:39:42 user nova-compute[75203]:     </nova:instance>
Nov 28 18:39:42 user nova-compute[75203]:   </metadata>
Nov 28 18:39:42 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:39:42 user nova-compute[75203]:     <system>
Nov 28 18:39:42 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:39:42 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:39:42 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:39:42 user nova-compute[75203]:       <entry name="serial">1a74de08-00b4-4fde-b1df-0af9ab5001b0</entry>
Nov 28 18:39:42 user nova-compute[75203]:       <entry name="uuid">1a74de08-00b4-4fde-b1df-0af9ab5001b0</entry>
Nov 28 18:39:42 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:39:42 user nova-compute[75203]:     </system>
Nov 28 18:39:42 user nova-compute[75203]:   </sysinfo>
Nov 28 18:39:42 user nova-compute[75203]:   <os>
Nov 28 18:39:42 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:39:42 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:39:42 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:39:42 user nova-compute[75203]:   </os>
Nov 28 18:39:42 user nova-compute[75203]:   <features>
Nov 28 18:39:42 user nova-compute[75203]:     <acpi/>
Nov 28 18:39:42 user nova-compute[75203]:     <apic/>
Nov 28 18:39:42 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:39:42 user nova-compute[75203]:   </features>
Nov 28 18:39:42 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:39:42 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:39:42 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:39:42 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:39:42 user nova-compute[75203]:   </clock>
Nov 28 18:39:42 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:39:42 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:39:42 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:39:42 user nova-compute[75203]:   </cpu>
Nov 28 18:39:42 user nova-compute[75203]:   <devices>
Nov 28 18:39:42 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:39:42 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:39:42 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk"/>
Nov 28 18:39:42 user nova-compute[75203]:       <target dev="sda" bus="scsi"/>
Nov 28 18:39:42 user nova-compute[75203]:       <address type="drive" controller="0" unit="0"/>
Nov 28 18:39:42 user nova-compute[75203]:     </disk>
Nov 28 18:39:42 user nova-compute[75203]:     <disk type="file" device="cdrom">
Nov 28 18:39:42 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 18:39:42 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk.config"/>
Nov 28 18:39:42 user nova-compute[75203]:       <target dev="sdb" bus="scsi"/>
Nov 28 18:39:42 user nova-compute[75203]:       <address type="drive" controller="0" unit="1"/>
Nov 28 18:39:42 user nova-compute[75203]:     </disk>
Nov 28 18:39:42 user nova-compute[75203]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 28 18:39:42 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:39:42 user nova-compute[75203]:       <mac address="fa:16:3e:6b:bc:a0"/>
Nov 28 18:39:42 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:39:42 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:39:42 user nova-compute[75203]:       <target dev="tap96f2c936-b1"/>
Nov 28 18:39:42 user nova-compute[75203]:     </interface>
Nov 28 18:39:42 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:39:42 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/console.log" append="off"/>
Nov 28 18:39:42 user nova-compute[75203]:     </serial>
Nov 28 18:39:42 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:39:42 user nova-compute[75203]:     <video>
Nov 28 18:39:42 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:39:42 user nova-compute[75203]:     </video>
Nov 28 18:39:42 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:39:42 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:39:42 user nova-compute[75203]:     </rng>
Nov 28 18:39:42 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:39:42 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:39:42 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:39:42 user nova-compute[75203]:     </memballoon>
Nov 28 18:39:42 user nova-compute[75203]:   </devices>
Nov 28 18:39:42 user nova-compute[75203]: </domain>
Nov 28 18:39:42 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-103806647',display_name='tempest-AttachSCSIVolumeTestJSON-server-103806647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-103806647',id=16,image_ref='679ccc27-04ab-4552-8dc0-be4b06daf258',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbWqCaByOWIC3Lp+ogJb9rMViXkQ6Wl58OGHo3Ip5VA6E8w4wILIZuFFAeLgFkwhyU6qfJZneeg62pLIv906vQfHnXdHlI7wB7H5qnN5kMhLWu3gwEpNAMjP9stFqwUjQ==',key_name='tempest-keypair-1357937852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e94875ddb5214ab6868b5e1c8e2d808e',ramdisk_id='',reservation_id='r-dnm6aha6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='679ccc27-04ab-4552-8dc0-be4b06daf258',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-453690146',owner_user_name='tempest-AttachSCSIVolumeTestJSON-453690146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be936df829fd467e9905758c55d5cb19',uuid=1a74de08-00b4-4fde-b1df-0af9ab5001b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Converting VIF {"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bc:a0,bridge_name='br-int',has_traffic_filtering=True,id=96f2c936-b17c-4576-88e3-bceabf0d612b,network=Network(cf2d5c11-12bc-471b-b75a-c6f68db4e31f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2c936-b1') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG os_vif [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bc:a0,bridge_name='br-int',has_traffic_filtering=True,id=96f2c936-b17c-4576-88e3-bceabf0d612b,network=Network(cf2d5c11-12bc-471b-b75a-c6f68db4e31f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2c936-b1') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad1cccfb-6f45-5a1a-8ac3-b9cbec74b41e', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96f2c936-b1, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96f2c936-b1, col_values=(('qos', UUID('0bb5220c-0186-481d-a08f-4e7c3ba91d47')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96f2c936-b1, col_values=(('external_ids', {'iface-id': '96f2c936-b17c-4576-88e3-bceabf0d612b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:bc:a0', 'vm-uuid': '1a74de08-00b4-4fde-b1df-0af9ab5001b0'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:39:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:42 user nova-compute[75203]: INFO os_vif [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:bc:a0,bridge_name='br-int',has_traffic_filtering=True,id=96f2c936-b17c-4576-88e3-bceabf0d612b,network=Network(cf2d5c11-12bc-471b-b75a-c6f68db4e31f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2c936-b1')
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] No BDM found with device name sda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] No VIF found with MAC fa:16:3e:6b:bc:a0, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:39:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Using config drive
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Creating config drive at /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk.config
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf6vwrlv3 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf6vwrlv3" returned: 0 in 0.094s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG nova.network.neutron [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Updated VIF entry in instance network info cache for port 96f2c936-b17c-4576-88e3-bceabf0d612b. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG nova.network.neutron [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Updating instance_info_cache with network_info: [{"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f74a1b96-9069-4863-be83-03c9fa9ba0ae req-657e5ca9-5a60-4a79-b11f-d95dd7bcdda4 service nova] Releasing lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-d4e73b2c-421c-45a4-9e0f-43c30bc9bf6c req-e5e245ac-3e23-4637-9684-01aa93b19ad5 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d4e73b2c-421c-45a4-9e0f-43c30bc9bf6c req-e5e245ac-3e23-4637-9684-01aa93b19ad5 service nova] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d4e73b2c-421c-45a4-9e0f-43c30bc9bf6c req-e5e245ac-3e23-4637-9684-01aa93b19ad5 service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d4e73b2c-421c-45a4-9e0f-43c30bc9bf6c req-e5e245ac-3e23-4637-9684-01aa93b19ad5 service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-d4e73b2c-421c-45a4-9e0f-43c30bc9bf6c req-e5e245ac-3e23-4637-9684-01aa93b19ad5 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] No waiting events found dispatching network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:45 user nova-compute[75203]: WARNING nova.compute.manager [req-d4e73b2c-421c-45a4-9e0f-43c30bc9bf6c req-e5e245ac-3e23-4637-9684-01aa93b19ad5 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received unexpected event network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b for instance with vm_state building and task_state spawning.
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-03e75eaa-5e6a-45d3-a62f-0c579230b6d2 req-73edb387-a73a-401b-9828-dbc73cd00c57 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03e75eaa-5e6a-45d3-a62f-0c579230b6d2 req-73edb387-a73a-401b-9828-dbc73cd00c57 service nova] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03e75eaa-5e6a-45d3-a62f-0c579230b6d2 req-73edb387-a73a-401b-9828-dbc73cd00c57 service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03e75eaa-5e6a-45d3-a62f-0c579230b6d2 req-73edb387-a73a-401b-9828-dbc73cd00c57 service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-03e75eaa-5e6a-45d3-a62f-0c579230b6d2 req-73edb387-a73a-401b-9828-dbc73cd00c57 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] No waiting events found dispatching network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:47 user nova-compute[75203]: WARNING nova.compute.manager [req-03e75eaa-5e6a-45d3-a62f-0c579230b6d2 req-73edb387-a73a-401b-9828-dbc73cd00c57 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received unexpected event network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b for instance with vm_state building and task_state spawning.
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:39:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Instance spawned successfully.
Nov 28 18:39:47 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:47 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=25.23687744140625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:47 user nova-compute[75203]: INFO nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Took 8.11 seconds to spawn the instance on the hypervisor.
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance eec19476-5b8e-4d91-b0e3-6ecd0986632d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 1c277046-cdb1-4499-b8d2-8c18d9913dd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43538aa1-3ebe-4098-bd42-78353ed457ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:39:47 user nova-compute[75203]: INFO nova.compute.manager [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Took 9.19 seconds to build instance.
Nov 28 18:39:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3e46d104-d4ab-48c5-8a41-c09d362cb7f4 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.300s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:48 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:39:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:39:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:39:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:39:49 user nova-compute[75203]: INFO nova.compute.claims [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Claim successful on node user
Nov 28 18:39:49 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:39:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:39:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:39:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG nova.policy [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72568e67e6f34f6584962ffea5d48f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e89044cd2ec4716af0b204c9b107772', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:39:50 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Creating image(s)
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "/opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "/opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "/opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.215s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk 1073741824" returned: 0 in 0.053s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.225s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:39:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Successfully created port: a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Cannot resize image /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Ensure instance console log exists: /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:39:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Successfully updated port: a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "refresh_cache-7075cd97-3bc9-4846-bf86-8ba9da8519ad" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquired lock "refresh_cache-7075cd97-3bc9-4846-bf86-8ba9da8519ad" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received event network-changed-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Refreshing instance network info cache due to event network-changed-a83a4da3-9a92-488d-8643-3a4312bf13f0. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] Acquiring lock "refresh_cache-7075cd97-3bc9-4846-bf86-8ba9da8519ad" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Updating instance_info_cache with network_info: [{"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Releasing lock "refresh_cache-7075cd97-3bc9-4846-bf86-8ba9da8519ad" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Instance network_info: |[{"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] Acquired lock "refresh_cache-7075cd97-3bc9-4846-bf86-8ba9da8519ad" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Refreshing network info cache for port a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Start _get_guest_xml network_info=[{"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:39:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2000795404',display_name='tempest-ServersNegativeTestJSON-server-2000795404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2000795404',id=17,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e89044cd2ec4716af0b204c9b107772',ramdisk_id='',reservation_id='r-9jyo8i3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-617619106',owner_user_name='tempest-ServersNegativeTestJSON-617619106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:39:50Z,user_data=None,user_id='72568e67e6f34f6584962ffea5d48f6f',uuid=7075cd97-3bc9-4846-bf86-8ba9da8519ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converting VIF {"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:9c,bridge_name='br-int',has_traffic_filtering=True,id=a83a4da3-9a92-488d-8643-3a4312bf13f0,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83a4da3-9a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lazy-loading 'pci_devices' on Instance uuid 7075cd97-3bc9-4846-bf86-8ba9da8519ad {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:39:52 user nova-compute[75203]:   <uuid>7075cd97-3bc9-4846-bf86-8ba9da8519ad</uuid>
Nov 28 18:39:52 user nova-compute[75203]:   <name>instance-00000011</name>
Nov 28 18:39:52 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:39:52 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:39:52 user nova-compute[75203]:   <metadata>
Nov 28 18:39:52 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:39:52 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:39:52 user nova-compute[75203]:       <nova:name>tempest-ServersNegativeTestJSON-server-2000795404</nova:name>
Nov 28 18:39:52 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:39:52</nova:creationTime>
Nov 28 18:39:52 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:39:52 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:39:52 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:39:52 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:39:52 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:39:52 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:39:52 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:39:52 user nova-compute[75203]:       <nova:owner>
Nov 28 18:39:52 user nova-compute[75203]:         <nova:user uuid="72568e67e6f34f6584962ffea5d48f6f">tempest-ServersNegativeTestJSON-617619106-project-member</nova:user>
Nov 28 18:39:52 user nova-compute[75203]:         <nova:project uuid="9e89044cd2ec4716af0b204c9b107772">tempest-ServersNegativeTestJSON-617619106</nova:project>
Nov 28 18:39:52 user nova-compute[75203]:       </nova:owner>
Nov 28 18:39:52 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:39:52 user nova-compute[75203]:       <nova:ports>
Nov 28 18:39:52 user nova-compute[75203]:         <nova:port uuid="a83a4da3-9a92-488d-8643-3a4312bf13f0">
Nov 28 18:39:52 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 18:39:52 user nova-compute[75203]:         </nova:port>
Nov 28 18:39:52 user nova-compute[75203]:       </nova:ports>
Nov 28 18:39:52 user nova-compute[75203]:     </nova:instance>
Nov 28 18:39:52 user nova-compute[75203]:   </metadata>
Nov 28 18:39:52 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:39:52 user nova-compute[75203]:     <system>
Nov 28 18:39:52 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:39:52 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:39:52 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:39:52 user nova-compute[75203]:       <entry name="serial">7075cd97-3bc9-4846-bf86-8ba9da8519ad</entry>
Nov 28 18:39:52 user nova-compute[75203]:       <entry name="uuid">7075cd97-3bc9-4846-bf86-8ba9da8519ad</entry>
Nov 28 18:39:52 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:39:52 user nova-compute[75203]:     </system>
Nov 28 18:39:52 user nova-compute[75203]:   </sysinfo>
Nov 28 18:39:52 user nova-compute[75203]:   <os>
Nov 28 18:39:52 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:39:52 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:39:52 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:39:52 user nova-compute[75203]:   </os>
Nov 28 18:39:52 user nova-compute[75203]:   <features>
Nov 28 18:39:52 user nova-compute[75203]:     <acpi/>
Nov 28 18:39:52 user nova-compute[75203]:     <apic/>
Nov 28 18:39:52 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:39:52 user nova-compute[75203]:   </features>
Nov 28 18:39:52 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:39:52 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:39:52 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:39:52 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:39:52 user nova-compute[75203]:   </clock>
Nov 28 18:39:52 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:39:52 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:39:52 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:39:52 user nova-compute[75203]:   </cpu>
Nov 28 18:39:52 user nova-compute[75203]:   <devices>
Nov 28 18:39:52 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:39:52 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:39:52 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk"/>
Nov 28 18:39:52 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:39:52 user nova-compute[75203]:     </disk>
Nov 28 18:39:52 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:39:52 user nova-compute[75203]:       <mac address="fa:16:3e:78:0a:9c"/>
Nov 28 18:39:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:39:52 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:39:52 user nova-compute[75203]:       <target dev="tapa83a4da3-9a"/>
Nov 28 18:39:52 user nova-compute[75203]:     </interface>
Nov 28 18:39:52 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:39:52 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/console.log" append="off"/>
Nov 28 18:39:52 user nova-compute[75203]:     </serial>
Nov 28 18:39:52 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:39:52 user nova-compute[75203]:     <video>
Nov 28 18:39:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:39:52 user nova-compute[75203]:     </video>
Nov 28 18:39:52 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:39:52 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:39:52 user nova-compute[75203]:     </rng>
Nov 28 18:39:52 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:39:52 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:39:52 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:39:52 user nova-compute[75203]:     </memballoon>
Nov 28 18:39:52 user nova-compute[75203]:   </devices>
Nov 28 18:39:52 user nova-compute[75203]: </domain>
Nov 28 18:39:52 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2000795404',display_name='tempest-ServersNegativeTestJSON-server-2000795404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2000795404',id=17,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e89044cd2ec4716af0b204c9b107772',ramdisk_id='',reservation_id='r-9jyo8i3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-617619106',owner_user_name='tempest-ServersNegativeTestJSON-617619106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:39:50Z,user_data=None,user_id='72568e67e6f34f6584962ffea5d48f6f',uuid=7075cd97-3bc9-4846-bf86-8ba9da8519ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converting VIF {"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:9c,bridge_name='br-int',has_traffic_filtering=True,id=a83a4da3-9a92-488d-8643-3a4312bf13f0,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83a4da3-9a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG os_vif [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:9c,bridge_name='br-int',has_traffic_filtering=True,id=a83a4da3-9a92-488d-8643-3a4312bf13f0,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83a4da3-9a') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6be012f9-4b9c-58ca-b1b0-16a3d386f460', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa83a4da3-9a, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa83a4da3-9a, col_values=(('qos', UUID('08c95bdc-74d5-49e5-8228-d83081b25679')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa83a4da3-9a, col_values=(('external_ids', {'iface-id': 'a83a4da3-9a92-488d-8643-3a4312bf13f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:0a:9c', 'vm-uuid': '7075cd97-3bc9-4846-bf86-8ba9da8519ad'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:52 user nova-compute[75203]: INFO os_vif [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:9c,bridge_name='br-int',has_traffic_filtering=True,id=a83a4da3-9a92-488d-8643-3a4312bf13f0,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83a4da3-9a')
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] No VIF found with MAC fa:16:3e:78:0a:9c, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:39:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Updated VIF entry in instance network info cache for port a83a4da3-9a92-488d-8643-3a4312bf13f0. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:39:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Updating instance_info_cache with network_info: [{"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8766f775-688b-4971-a86d-e5b98a90efca req-417f5e81-f68f-4218-b21a-da1c104aacb2 service nova] Releasing lock "refresh_cache-7075cd97-3bc9-4846-bf86-8ba9da8519ad" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-7eb33ee5-06e0-4845-b3a7-59e3682cb52d req-65d43346-1e20-46b3-9297-3d6a7376c6e1 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received event network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7eb33ee5-06e0-4845-b3a7-59e3682cb52d req-65d43346-1e20-46b3-9297-3d6a7376c6e1 service nova] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7eb33ee5-06e0-4845-b3a7-59e3682cb52d req-65d43346-1e20-46b3-9297-3d6a7376c6e1 service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7eb33ee5-06e0-4845-b3a7-59e3682cb52d req-65d43346-1e20-46b3-9297-3d6a7376c6e1 service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-7eb33ee5-06e0-4845-b3a7-59e3682cb52d req-65d43346-1e20-46b3-9297-3d6a7376c6e1 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] No waiting events found dispatching network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:54 user nova-compute[75203]: WARNING nova.compute.manager [req-7eb33ee5-06e0-4845-b3a7-59e3682cb52d req-65d43346-1e20-46b3-9297-3d6a7376c6e1 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received unexpected event network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 for instance with vm_state building and task_state spawning.
Nov 28 18:39:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-bb725c08-960a-4011-b1b2-83da738122f8 req-40c70b67-2533-4adc-b404-c94132eea3c6 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received event network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bb725c08-960a-4011-b1b2-83da738122f8 req-40c70b67-2533-4adc-b404-c94132eea3c6 service nova] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bb725c08-960a-4011-b1b2-83da738122f8 req-40c70b67-2533-4adc-b404-c94132eea3c6 service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bb725c08-960a-4011-b1b2-83da738122f8 req-40c70b67-2533-4adc-b404-c94132eea3c6 service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-bb725c08-960a-4011-b1b2-83da738122f8 req-40c70b67-2533-4adc-b404-c94132eea3c6 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] No waiting events found dispatching network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:56 user nova-compute[75203]: WARNING nova.compute.manager [req-bb725c08-960a-4011-b1b2-83da738122f8 req-40c70b67-2533-4adc-b404-c94132eea3c6 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received unexpected event network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 for instance with vm_state building and task_state spawning.
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:39:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Instance spawned successfully.
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:39:56 user nova-compute[75203]: INFO nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Took 6.82 seconds to spawn the instance on the hypervisor.
Nov 28 18:39:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:39:57 user nova-compute[75203]: INFO nova.compute.manager [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Took 7.71 seconds to build instance.
Nov 28 18:39:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4163b075-5b9c-43ec-9bca-91de05c34e2d tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.953s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:57 user nova-compute[75203]: INFO nova.compute.manager [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Terminating instance
Nov 28 18:39:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:57 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Instance destroyed successfully.
Nov 28 18:39:57 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lazy-loading 'resources' on Instance uuid 1c277046-cdb1-4499-b8d2-8c18d9913dd9 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:37:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-371110027',display_name='tempest-VolumesAdminNegativeTest-server-371110027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-371110027',id=14,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2feb0fa92b6443b1afa886bfd04e7f80',ramdisk_id='',reservation_id='r-3j51w71q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1771058656',owner_user_name='tempest-VolumesAdminNegativeTest-1771058656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:38:07Z,user_data=None,user_id='b0bbf1727aff4c61b80cc15f640a20f6',uuid=1c277046-cdb1-4499-b8d2-8c18d9913dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converting VIF {"id": "15cf3830-814d-4fa2-b901-1245c9fa028e", "address": "fa:16:3e:45:89:d1", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15cf3830-81", "ovs_interfaceid": "15cf3830-814d-4fa2-b901-1245c9fa028e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:89:d1,bridge_name='br-int',has_traffic_filtering=True,id=15cf3830-814d-4fa2-b901-1245c9fa028e,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15cf3830-81') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG os_vif [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:89:d1,bridge_name='br-int',has_traffic_filtering=True,id=15cf3830-814d-4fa2-b901-1245c9fa028e,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15cf3830-81') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15cf3830-81, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4edda70-a019-4ff2-b676-482ed053addf) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:39:58 user nova-compute[75203]: INFO os_vif [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:89:d1,bridge_name='br-int',has_traffic_filtering=True,id=15cf3830-814d-4fa2-b901-1245c9fa028e,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15cf3830-81')
Nov 28 18:39:58 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Deleting instance files /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9_del
Nov 28 18:39:58 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Deletion of /opt/stack/data/nova/instances/1c277046-cdb1-4499-b8d2-8c18d9913dd9_del complete
Nov 28 18:39:58 user nova-compute[75203]: INFO nova.compute.manager [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received event network-vif-unplugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] Acquiring lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] No waiting events found dispatching network-vif-unplugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received event network-vif-unplugged-15cf3830-814d-4fa2-b901-1245c9fa028e for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received event network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] Acquiring lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] No waiting events found dispatching network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:39:58 user nova-compute[75203]: WARNING nova.compute.manager [req-f80c7dea-95cf-4c95-8a02-608f6bf15c92 req-61ae190b-2161-4a9c-9a86-0e102de97a12 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received unexpected event network-vif-plugged-15cf3830-814d-4fa2-b901-1245c9fa028e for instance with vm_state active and task_state deleting.
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:58 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Took 0.74 seconds to deallocate network for instance.
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-d888028f-46df-41d0-a5ef-98c02add9bba req-ed906856-d4bc-450e-9016-24614a23c487 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Received event network-vif-deleted-15cf3830-814d-4fa2-b901-1245c9fa028e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:39:58 user nova-compute[75203]: INFO nova.compute.manager [req-d888028f-46df-41d0-a5ef-98c02add9bba req-ed906856-d4bc-450e-9016-24614a23c487 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Neutron deleted interface 15cf3830-814d-4fa2-b901-1245c9fa028e; detaching it from the instance and deleting it from the info cache
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.network.neutron [req-d888028f-46df-41d0-a5ef-98c02add9bba req-ed906856-d4bc-450e-9016-24614a23c487 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-d888028f-46df-41d0-a5ef-98c02add9bba req-ed906856-d4bc-450e-9016-24614a23c487 service nova] [instance: 1c277046-cdb1-4499-b8d2-8c18d9913dd9] Detach interface failed, port_id=15cf3830-814d-4fa2-b901-1245c9fa028e, reason: Instance 1c277046-cdb1-4499-b8d2-8c18d9913dd9 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:39:58 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:39:58 user nova-compute[75203]: INFO nova.compute.claims [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Claim successful on node user
Nov 28 18:39:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.548s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:39:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.policy [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6695b6171894c0ab01d4f5e64af03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c45c2671f2344fc93f3f578c8ebf0f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:39:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Creating image(s)
Nov 28 18:39:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:39:59 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.234s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:00 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Deleted allocations for instance 1c277046-cdb1-4499-b8d2-8c18d9913dd9
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ee261a36-44ac-4b35-9a25-d688326d9a2b tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "1c277046-cdb1-4499-b8d2-8c18d9913dd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.076s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk 1073741824" returned: 0 in 0.055s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Successfully created port: 51986925-f22e-4528-b519-836232111180 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Cannot resize image /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Ensure instance console log exists: /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Successfully updated port: 51986925-f22e-4528-b519-836232111180 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-changed-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Refreshing instance network info cache due to event network-changed-51986925-f22e-4528-b519-836232111180. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance network_info: |[{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Refreshing network info cache for port 51986925-f22e-4528-b519-836232111180 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Start _get_guest_xml network_info=[{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:40:01 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:40:01 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:40:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lazy-loading 'pci_devices' on Instance uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:40:02 user nova-compute[75203]:   <uuid>449f7a33-7a5a-4618-b840-59039ed50492</uuid>
Nov 28 18:40:02 user nova-compute[75203]:   <name>instance-00000012</name>
Nov 28 18:40:02 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:40:02 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:40:02 user nova-compute[75203]:   <metadata>
Nov 28 18:40:02 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:40:02 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:40:02 user nova-compute[75203]:       <nova:name>tempest-ServerActionsTestOtherB-server-937811796</nova:name>
Nov 28 18:40:02 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:40:01</nova:creationTime>
Nov 28 18:40:02 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:40:02 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:40:02 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:40:02 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:40:02 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:40:02 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:40:02 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:40:02 user nova-compute[75203]:       <nova:owner>
Nov 28 18:40:02 user nova-compute[75203]:         <nova:user uuid="c6695b6171894c0ab01d4f5e64af03ba">tempest-ServerActionsTestOtherB-1400740793-project-member</nova:user>
Nov 28 18:40:02 user nova-compute[75203]:         <nova:project uuid="6c45c2671f2344fc93f3f578c8ebf0f0">tempest-ServerActionsTestOtherB-1400740793</nova:project>
Nov 28 18:40:02 user nova-compute[75203]:       </nova:owner>
Nov 28 18:40:02 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:40:02 user nova-compute[75203]:       <nova:ports>
Nov 28 18:40:02 user nova-compute[75203]:         <nova:port uuid="51986925-f22e-4528-b519-836232111180">
Nov 28 18:40:02 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 18:40:02 user nova-compute[75203]:         </nova:port>
Nov 28 18:40:02 user nova-compute[75203]:       </nova:ports>
Nov 28 18:40:02 user nova-compute[75203]:     </nova:instance>
Nov 28 18:40:02 user nova-compute[75203]:   </metadata>
Nov 28 18:40:02 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:40:02 user nova-compute[75203]:     <system>
Nov 28 18:40:02 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:40:02 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:40:02 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:40:02 user nova-compute[75203]:       <entry name="serial">449f7a33-7a5a-4618-b840-59039ed50492</entry>
Nov 28 18:40:02 user nova-compute[75203]:       <entry name="uuid">449f7a33-7a5a-4618-b840-59039ed50492</entry>
Nov 28 18:40:02 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:40:02 user nova-compute[75203]:     </system>
Nov 28 18:40:02 user nova-compute[75203]:   </sysinfo>
Nov 28 18:40:02 user nova-compute[75203]:   <os>
Nov 28 18:40:02 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:40:02 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:40:02 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:40:02 user nova-compute[75203]:   </os>
Nov 28 18:40:02 user nova-compute[75203]:   <features>
Nov 28 18:40:02 user nova-compute[75203]:     <acpi/>
Nov 28 18:40:02 user nova-compute[75203]:     <apic/>
Nov 28 18:40:02 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:40:02 user nova-compute[75203]:   </features>
Nov 28 18:40:02 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:40:02 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:40:02 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:40:02 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:40:02 user nova-compute[75203]:   </clock>
Nov 28 18:40:02 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:40:02 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:40:02 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:40:02 user nova-compute[75203]:   </cpu>
Nov 28 18:40:02 user nova-compute[75203]:   <devices>
Nov 28 18:40:02 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:40:02 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:40:02 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk"/>
Nov 28 18:40:02 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:40:02 user nova-compute[75203]:     </disk>
Nov 28 18:40:02 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:40:02 user nova-compute[75203]:       <mac address="fa:16:3e:7e:8f:c7"/>
Nov 28 18:40:02 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:40:02 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:40:02 user nova-compute[75203]:       <target dev="tap51986925-f2"/>
Nov 28 18:40:02 user nova-compute[75203]:     </interface>
Nov 28 18:40:02 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:40:02 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/console.log" append="off"/>
Nov 28 18:40:02 user nova-compute[75203]:     </serial>
Nov 28 18:40:02 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:40:02 user nova-compute[75203]:     <video>
Nov 28 18:40:02 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:40:02 user nova-compute[75203]:     </video>
Nov 28 18:40:02 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:40:02 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:40:02 user nova-compute[75203]:     </rng>
Nov 28 18:40:02 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:40:02 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:40:02 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:40:02 user nova-compute[75203]:     </memballoon>
Nov 28 18:40:02 user nova-compute[75203]:   </devices>
Nov 28 18:40:02 user nova-compute[75203]: </domain>
Nov 28 18:40:02 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG os_vif [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '828c960f-68b2-5321-8d67-05dccf7c3270', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51986925-f2, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51986925-f2, col_values=(('qos', UUID('b9662ec5-31ea-44c4-b2bc-8d0086526c75')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51986925-f2, col_values=(('external_ids', {'iface-id': '51986925-f22e-4528-b519-836232111180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:8f:c7', 'vm-uuid': '449f7a33-7a5a-4618-b840-59039ed50492'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:02 user nova-compute[75203]: INFO os_vif [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2')
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No VIF found with MAC fa:16:3e:7e:8f:c7, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updated VIF entry in instance network info cache for port 51986925-f22e-4528-b519-836232111180. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de492697-b9a8-4cce-92b0-19b45cd6445b req-bc393158-8bf6-4ed2-ae0a-a2aebf6351b9 service nova] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:40:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-2a95149c-f377-40ae-9d3a-62be7d39710c req-cdb371b3-6e01-4111-85c4-4aa753c2bc6b service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2a95149c-f377-40ae-9d3a-62be7d39710c req-cdb371b3-6e01-4111-85c4-4aa753c2bc6b service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2a95149c-f377-40ae-9d3a-62be7d39710c req-cdb371b3-6e01-4111-85c4-4aa753c2bc6b service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2a95149c-f377-40ae-9d3a-62be7d39710c req-cdb371b3-6e01-4111-85c4-4aa753c2bc6b service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-2a95149c-f377-40ae-9d3a-62be7d39710c req-cdb371b3-6e01-4111-85c4-4aa753c2bc6b service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:03 user nova-compute[75203]: WARNING nova.compute.manager [req-2a95149c-f377-40ae-9d3a-62be7d39710c req-cdb371b3-6e01-4111-85c4-4aa753c2bc6b service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state building and task_state spawning.
Nov 28 18:40:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-d2dfe262-1d71-410f-85b8-2125c3253059 req-bbb0dcc3-d1dc-45f6-800f-8584ce8acdfd service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d2dfe262-1d71-410f-85b8-2125c3253059 req-bbb0dcc3-d1dc-45f6-800f-8584ce8acdfd service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d2dfe262-1d71-410f-85b8-2125c3253059 req-bbb0dcc3-d1dc-45f6-800f-8584ce8acdfd service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d2dfe262-1d71-410f-85b8-2125c3253059 req-bbb0dcc3-d1dc-45f6-800f-8584ce8acdfd service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-d2dfe262-1d71-410f-85b8-2125c3253059 req-bbb0dcc3-d1dc-45f6-800f-8584ce8acdfd service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:06 user nova-compute[75203]: WARNING nova.compute.manager [req-d2dfe262-1d71-410f-85b8-2125c3253059 req-bbb0dcc3-d1dc-45f6-800f-8584ce8acdfd service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state building and task_state spawning.
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:40:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance spawned successfully.
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:40:06 user nova-compute[75203]: INFO nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 28 18:40:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:40:06 user nova-compute[75203]: INFO nova.compute.manager [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Took 7.58 seconds to build instance.
Nov 28 18:40:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f1dd1347-96fc-4ec0-b796-e3e34379379d tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.722s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:24 user nova-compute[75203]: INFO nova.compute.manager [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Detaching volume b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2
Nov 28 18:40:24 user nova-compute[75203]: INFO nova.virt.block_device [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Attempting to driver detach volume b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 from mountpoint /dev/vdc
Nov 28 18:40:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Attempting to detach device vdc from instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:40:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:40:24 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:40:24 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:40:24 user nova-compute[75203]:   <target dev="vdc" bus="virtio"/>
Nov 28 18:40:24 user nova-compute[75203]:   <serial>b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2</serial>
Nov 28 18:40:24 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 18:40:24 user nova-compute[75203]: </disk>
Nov 28 18:40:24 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:40:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully detached device vdc from instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb from the persistent domain config.
Nov 28 18:40:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:40:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:40:24 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:40:24 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:40:24 user nova-compute[75203]:   <target dev="vdc" bus="virtio"/>
Nov 28 18:40:24 user nova-compute[75203]:   <serial>b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2</serial>
Nov 28 18:40:24 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 18:40:24 user nova-compute[75203]: </disk>
Nov 28 18:40:24 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:40:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:40:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-changed-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Refreshing instance network info cache due to event network-changed-a7fb7677-2bdc-4383-88b0-ba6caecb778a. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:40:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] Acquiring lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:40:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] Acquired lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:40:26 user nova-compute[75203]: DEBUG nova.network.neutron [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Refreshing network info cache for port a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG nova.network.neutron [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updated VIF entry in instance network info cache for port a7fb7677-2bdc-4383-88b0-ba6caecb778a. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG nova.network.neutron [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updating instance_info_cache with network_info: [{"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-63ce0c9d-78c1-45ca-9227-a79b39e6722b req-18b402e7-88bb-49a8-bdc8-95cf595c14c0 service nova] Releasing lock "refresh_cache-43538aa1-3ebe-4098-bd42-78353ed457ce" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG nova.objects.instance [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'flavor' on Instance uuid 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:27 user nova-compute[75203]: INFO nova.compute.manager [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Attaching volume 8bf8ef1a-68e8-4348-95fd-16b892e29738 to /dev/vdb
Nov 28 18:40:27 user nova-compute[75203]: DEBUG os_brick.utils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a376cd-d3c0-40f4-a79c-caa69e0470b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[db69c718-f2db-4963-bfa5-b5d48275ae45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.051s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f635318-2c74-42b1-ad9e-717982d1c8fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ff51f1-0c09-46b4-b1f8-39eafee1a3a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:40:27 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:40:27 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[de43a8d5-ccd7-46e2-a840-058c36447512]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG os_brick.utils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updating existing volume attachment record: a9b5eed0-bf0c-4d69-85b9-a8126c2bff5c {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:40:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:40:35 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:40:35 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:40:35 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d74c83-f56d-4149-b45a-579bd330a544]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:40:35 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af59c7c2-cf20-4229-a03f-acc2b413bfb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738] added
Nov 28 18:40:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c9b66-8355-45a8-8fd7-ef4747b1158e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0398ac9-2c5c-4d2a-b2bc-6c9057566730]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTEjbspr {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTEjbspr" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcedd60-1c90-4b3f-94de-fba823403b06]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WTEjbspr'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1de1dd-2e05-409b-82df-72fad59e5bd1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[120478f4-191a-4869-96e1-4f07d8588b9f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:35 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:35 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7d118a-cc65-4e91-b73c-b9c1215bf298]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]
Nov 28 18:40:35 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.
Nov 28 18:40:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a83803-7753-4f31-9062-143c6e534db6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffef91aa-03a2-4dbd-aa9c-dcecf213a139]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:35 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:35 user nova-compute[75203]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:40:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:35 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:35 user nova-compute[75203]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:40:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5214fe52-9aa2-45da-96c8-6a9498c6ca99]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26532616365383330', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532616365383330', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'flavor' on Instance uuid 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:40:36 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:40:36 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:40:36 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:40:36 user nova-compute[75203]:   <serial>8bf8ef1a-68e8-4348-95fd-16b892e29738</serial>
Nov 28 18:40:36 user nova-compute[75203]: </disk>
Nov 28 18:40:36 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 18:40:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No VIF found with MAC fa:16:3e:1a:23:1d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dce61d80-c3eb-4113-88c7-9d4ea0206eb0 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.752s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:40:38 user nova-compute[75203]: INFO nova.compute.manager [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Rebuilding instance
Nov 28 18:40:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:40:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:39 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:39 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance destroyed successfully.
Nov 28 18:40:39 user nova-compute[75203]: INFO nova.compute.manager [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Detaching volume 8bf8ef1a-68e8-4348-95fd-16b892e29738
Nov 28 18:40:39 user nova-compute[75203]: INFO nova.virt.block_device [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Attempting to driver detach volume 8bf8ef1a-68e8-4348-95fd-16b892e29738 from mountpoint /dev/vdb
Nov 28 18:40:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Attempting to detach device vdb from instance 43538aa1-3ebe-4098-bd42-78353ed457ce from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:40:40 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:40:40 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:40:40 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:40:40 user nova-compute[75203]:   <serial>8bf8ef1a-68e8-4348-95fd-16b892e29738</serial>
Nov 28 18:40:40 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:40:40 user nova-compute[75203]: </disk>
Nov 28 18:40:40 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:40:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully detached device vdb from instance 43538aa1-3ebe-4098-bd42-78353ed457ce from the persistent domain config.
Nov 28 18:40:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:40:40 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e3a5fe-db17-4ee7-851d-5eefdf92c061]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:40:40 user nova-compute[75203]: No targets found.
Nov 28 18:40:40 user nova-compute[75203]: iSNS:
Nov 28 18:40:40 user nova-compute[75203]: No targets found.
Nov 28 18:40:40 user nova-compute[75203]: STATIC:
Nov 28 18:40:40 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2
Nov 28 18:40:40 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:40:40 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:40:40 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738
Nov 28 18:40:40 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:40:40 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:40:40 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:40:40 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:40:40 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:40:40 user nova-compute[75203]: FIRMWARE:
Nov 28 18:40:40 user nova-compute[75203]: No targets found.
Nov 28 18:40:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:40:40 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:40:40 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfdf684-5cc0-4677-b9c2-9a98364f3973]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[183f3d0e-f70b-4f7d-98a7-d9ea45e1e281]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:40 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:40 user nova-compute[75203]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:40:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:40 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:40 user nova-compute[75203]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:40:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a0258700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5147e-f2ae-4597-8363-dde395bca858]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e94cec6-5f54-447d-b53f-dafd56526279]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d1946-5f72-4507-b927-f5c96565cbe8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7672ba-3d0a-453c-acbf-4bef3b5d7ea3]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7722dfda-2b72-475e-a2fe-b4d085aea64d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1c7c3-190f-4139-a8e5-df15f292fdd4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]
Nov 28 18:40:40 user nova-compute[75203]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.
Nov 28 18:40:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[436267ac-4678-40bb-897d-30824115225f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== disconnect_volume: return (321ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 18:40:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance destroyed successfully.
Nov 28 18:40:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-883710891',display_name='tempest-ServerActionsTestOtherA-server-474315397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-883710891',id=15,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxCc6vEhlAeiMgyKG6RNZ45Sr0UQX//i1sndSdsS4E5kd+SCD4AsLEHMeWVxO7Y//0/zPvjjBK6YosabO12NQfr0oUb4HQ9Yrce4dAJs7I43Ckntfds0dUck6EybhVqjA==',key_name='tempest-keypair-839735458',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:38:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-3rnm27ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=43538aa1-3ebe-4098-bd42-78353ed457ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_vif [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7fb7677-2b, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=794449c5-68bd-4df9-a042-67336565d841) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:42 user nova-compute[75203]: INFO os_vif [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b')
Nov 28 18:40:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:40:42 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c88f0-c653-4bc8-bdd3-381a0c068c8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:40:42 user nova-compute[75203]: No targets found.
Nov 28 18:40:42 user nova-compute[75203]: iSNS:
Nov 28 18:40:42 user nova-compute[75203]: No targets found.
Nov 28 18:40:42 user nova-compute[75203]: STATIC:
Nov 28 18:40:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2
Nov 28 18:40:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:40:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:40:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:40:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:40:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:40:42 user nova-compute[75203]: FIRMWARE:
Nov 28 18:40:42 user nova-compute[75203]: No targets found.
Nov 28 18:40:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:40:42 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:40:42 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fab00f-72cc-4762-a4b1-63ee67d0842e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0470775b-0e34-4924-b039-2ff255772325]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:42 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:42 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790454d30>, {}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Disconnecting from: [] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== disconnect_volume: return (76ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:40:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Deleting instance files /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce_del
Nov 28 18:40:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Deletion of /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce_del complete
Nov 28 18:40:42 user nova-compute[75203]: INFO nova.virt.block_device [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Booting with volume 8bf8ef1a-68e8-4348-95fd-16b892e29738 at /dev/vdb
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.utils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e76fd7e-ddd0-41de-af02-9f3bd3242255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fb32ad-3c62-427e-b0a2-aebcd33f0fd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[73652ee6-d9ed-4d0d-a1d2-bad65739b583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa7b69a-52f5-4fd6-b3e6-4dc14093e410]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:40:42 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa397b0-0910-48d5-9699-5f2844c8cc9b]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG os_brick.utils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updating existing volume attachment record: f4dda2ae-b237-4b49-8e93-9643e6c73721 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-9b39a180-263a-4f07-a888-59c68ef555d6 req-bc82a458-0b4b-4bf4-afc8-f1991fee32d7 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-unplugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9b39a180-263a-4f07-a888-59c68ef555d6 req-bc82a458-0b4b-4bf4-afc8-f1991fee32d7 service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9b39a180-263a-4f07-a888-59c68ef555d6 req-bc82a458-0b4b-4bf4-afc8-f1991fee32d7 service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9b39a180-263a-4f07-a888-59c68ef555d6 req-bc82a458-0b4b-4bf4-afc8-f1991fee32d7 service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-9b39a180-263a-4f07-a888-59c68ef555d6 req-bc82a458-0b4b-4bf4-afc8-f1991fee32d7 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-unplugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:44 user nova-compute[75203]: WARNING nova.compute.manager [req-9b39a180-263a-4f07-a888-59c68ef555d6 req-bc82a458-0b4b-4bf4-afc8-f1991fee32d7 service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received unexpected event network-vif-unplugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 28 18:40:44 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb is timed out.
Nov 28 18:40:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully detached device vdc from instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb from the live domain config.
Nov 28 18:40:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gbysfJdh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:40:44 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c94e2e-e059-4035-b6c5-8d8f91b893fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:40:44 user nova-compute[75203]: No targets found.
Nov 28 18:40:44 user nova-compute[75203]: iSNS:
Nov 28 18:40:44 user nova-compute[75203]: No targets found.
Nov 28 18:40:44 user nova-compute[75203]: STATIC:
Nov 28 18:40:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2
Nov 28 18:40:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:40:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:40:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:40:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:40:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:40:44 user nova-compute[75203]: FIRMWARE:
Nov 28 18:40:44 user nova-compute[75203]: No targets found.
Nov 28 18:40:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:40:44 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:40:44 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d9c51b-7893-435d-a7c9-352b9300b0fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd56f0-d702-41e2-aa8b-a54b8a348ced]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:44 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:44 user nova-compute[75203]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 (non-flash)
Nov 28 18:40:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790266320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:40:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc40bd9-ef69-41ca-9d20-046fee5eef99]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[241b4802-c818-4218-bedb-d2816e8b2711]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bdb5fa-6920-43e8-970d-80d8341d8122]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad8ed63-941f-4755-84c2-e8efb0a3605b]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7973ee4a-5bb4-43c6-9c8c-52ef4428f924]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3620d9da-4fd4-4f33-a498-6f2b335e0b23]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260]
Nov 28 18:40:45 user nova-compute[75203]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2, portal: 172.16.0.220,3260] successful.
Nov 28 18:40:45 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6dc5d2f-e122-4f33-8085-0bb87ad5c4b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f3ec2-3f1a-4cb8-aefb-aa50e72be111]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] <== disconnect_volume: return (370ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-d8da002c-1ced-45a5-a4f1-3379943a5304 req-88f05f6f-596e-4cf6-8f9a-708bd288bb7a service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8da002c-1ced-45a5-a4f1-3379943a5304 req-88f05f6f-596e-4cf6-8f9a-708bd288bb7a service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8da002c-1ced-45a5-a4f1-3379943a5304 req-88f05f6f-596e-4cf6-8f9a-708bd288bb7a service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8da002c-1ced-45a5-a4f1-3379943a5304 req-88f05f6f-596e-4cf6-8f9a-708bd288bb7a service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-d8da002c-1ced-45a5-a4f1-3379943a5304 req-88f05f6f-596e-4cf6-8f9a-708bd288bb7a service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:46 user nova-compute[75203]: WARNING nova.compute.manager [req-d8da002c-1ced-45a5-a4f1-3379943a5304 req-88f05f6f-596e-4cf6-8f9a-708bd288bb7a service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received unexpected event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:48 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:40:48 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=25.191879272460938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance eec19476-5b8e-4d91-b0e3-6ecd0986632d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43538aa1-3ebe-4098-bd42-78353ed457ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 7075cd97-3bc9-4846-bf86-8ba9da8519ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 18:40:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 18:40:49 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:40:49 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:40:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:40:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.939s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:49 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:40:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:50 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:40:50 user nova-compute[75203]: INFO nova.compute.claims [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Claim successful on node user
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:40:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.policy [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '693208da309146e9ba35bd3fd123cd89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90372eff92684a44a7d5a4f3c1583828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:40:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Creating image(s)
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "/opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "/opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "/opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk 1073741824" returned: 0 in 0.068s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.232s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:52 user nova-compute[75203]: INFO nova.compute.manager [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Terminating instance
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Successfully created port: 3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Cannot resize image /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Ensure instance console log exists: /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-98ffc48e-fe92-4d2d-a561-ad53c86ab8b9 req-1e32ea66-02a1-40a2-a6d6-9e394bacc424 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-vif-unplugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-98ffc48e-fe92-4d2d-a561-ad53c86ab8b9 req-1e32ea66-02a1-40a2-a6d6-9e394bacc424 service nova] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-98ffc48e-fe92-4d2d-a561-ad53c86ab8b9 req-1e32ea66-02a1-40a2-a6d6-9e394bacc424 service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-98ffc48e-fe92-4d2d-a561-ad53c86ab8b9 req-1e32ea66-02a1-40a2-a6d6-9e394bacc424 service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-98ffc48e-fe92-4d2d-a561-ad53c86ab8b9 req-1e32ea66-02a1-40a2-a6d6-9e394bacc424 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] No waiting events found dispatching network-vif-unplugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-98ffc48e-fe92-4d2d-a561-ad53c86ab8b9 req-1e32ea66-02a1-40a2-a6d6-9e394bacc424 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-vif-unplugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'flavor' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updating instance_info_cache with network_info: [{"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-b44f50fc-d483-4a67-8fd1-7146a3d0adbd" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_power_states {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d73f94f-7917-42dd-bce0-d5a37bd2d45e tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.840s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Instance destroyed successfully.
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.objects.instance [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lazy-loading 'resources' on Instance uuid b44f50fc-d483-4a67-8fd1-7146a3d0adbd {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:40:53 user nova-compute[75203]: WARNING nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 4382dd69-a9f8-45a8-ae99-78d295cb606f {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid b44f50fc-d483-4a67-8fd1-7146a3d0adbd {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 1a74de08-00b4-4fde-b1df-0af9ab5001b0 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 7075cd97-3bc9-4846-bf86-8ba9da8519ad {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "449f7a33-7a5a-4618-b840-59039ed50492" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: INFO nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1765760766',display_name='tempest-VolumesAdminNegativeTest-server-1765760766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1765760766',id=6,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0FbE9rTgIvG09DgEacIaGZ6yoMjlK3ZNCO9BL5YKOXc6zuwAHoutTz3pABzwnshx7ofiLq94i7cQdty0eZ16xbg5A77Pwg1Alo4APIx1+x0jsehHoKicUcie17NMDDPA==',key_name='tempest-keypair-1436859568',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2feb0fa92b6443b1afa886bfd04e7f80',ramdisk_id='',reservation_id='r-lbn6h2n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1771058656',owner_user_name='tempest-VolumesAdminNegativeTest-1771058656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bbf1727aff4c61b80cc15f640a20f6',uuid=b44f50fc-d483-4a67-8fd1-7146a3d0adbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converting VIF {"id": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "address": "fa:16:3e:16:4d:14", "network": {"id": "a94b3d63-3b27-4543-8487-9cef2e9957a1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-977927214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2feb0fa92b6443b1afa886bfd04e7f80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5718ecd4-de", "ovs_interfaceid": "5718ecd4-ded7-4efb-84a1-a0cfe3fabef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:4d:14,bridge_name='br-int',has_traffic_filtering=True,id=5718ecd4-ded7-4efb-84a1-a0cfe3fabef3,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5718ecd4-de') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG os_vif [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:4d:14,bridge_name='br-int',has_traffic_filtering=True,id=5718ecd4-ded7-4efb-84a1-a0cfe3fabef3,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5718ecd4-de') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5718ecd4-de, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8c1d90a-2223-428d-93a1-b25b287fbe5a) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:53 user nova-compute[75203]: INFO os_vif [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:4d:14,bridge_name='br-int',has_traffic_filtering=True,id=5718ecd4-ded7-4efb-84a1-a0cfe3fabef3,network=Network(a94b3d63-3b27-4543-8487-9cef2e9957a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5718ecd4-de')
Nov 28 18:40:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Deleting instance files /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd_del
Nov 28 18:40:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Deletion of /opt/stack/data/nova/instances/b44f50fc-d483-4a67-8fd1-7146a3d0adbd_del complete
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.191s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.191s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.215s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.223s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.232s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.237s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.245s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "449f7a33-7a5a-4618-b840-59039ed50492" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.251s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: INFO nova.compute.manager [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:40:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Creating image(s)
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Successfully updated port: 3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-changed-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Refreshing instance network info cache due to event network-changed-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] Acquiring lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] Acquired lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Refreshing network info cache for port 3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk 1073741824" returned: 0 in 0.051s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Cannot resize image /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Ensure instance console log exists: /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Start _get_guest_xml network_info=[{"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43538aa1-3ebe-4098-bd42-78353ed457ce', 'attached_at': '', 'detached_at': '', 'volume_id': '8bf8ef1a-68e8-4348-95fd-16b892e29738', 'serial': '8bf8ef1a-68e8-4348-95fd-16b892e29738'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'f4dda2ae-b237-4b49-8e93-9643e6c73721', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:40:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 18:40:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:40:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:40:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:40:54 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3a18bda-f522-4ba6-8ad2-67ebdecc97dd req-502bc9f9-0bd3-4e7c-a8e1-3b918de584ee service nova] Releasing lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquired lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abee83c-f6e0-496f-b1ad-24996f841a47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:40:54 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e990aead-2358-4111-a48f-b0beb2a5cbee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738] added
Nov 28 18:40:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0085c327-6fbf-4fc4-a9fd-ca466dcb3e9e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e469f-9985-448b-880e-e8f32ddd661d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTEjbspr {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTEjbspr" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c254492-6543-4044-9ab6-cd6054f0efdd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WTEjbspr'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a55887-25bb-4df8-ad46-7c11a67295ce]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b177cb-3d0a-4795-869e-03dba05c10f6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b1e51e-3f22-4e7f-a80a-f56a8de6d881]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]
Nov 28 18:40:54 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.
Nov 28 18:40:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d54af6b-2043-4af9-892e-dc6f2cb077ba]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198e234-fc54-4194-b78a-751da4311287]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:54 user nova-compute[75203]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:40:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:40:54 user nova-compute[75203]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:40:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.050s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db12656-a26a-41c0-ac5c-b8b4fbbf0734]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:40:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:40:55 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Took 1.46 seconds to deallocate network for instance.
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating instance_info_cache with network_info: [{"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-d0bff439-bcc0-4b9d-be55-471353f15896 req-187390e7-b289-40e8-aa1d-d1083b8d928b service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d0bff439-bcc0-4b9d-be55-471353f15896 req-187390e7-b289-40e8-aa1d-d1083b8d928b service nova] Acquiring lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d0bff439-bcc0-4b9d-be55-471353f15896 req-187390e7-b289-40e8-aa1d-d1083b8d928b service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d0bff439-bcc0-4b9d-be55-471353f15896 req-187390e7-b289-40e8-aa1d-d1083b8d928b service nova] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-d0bff439-bcc0-4b9d-be55-471353f15896 req-187390e7-b289-40e8-aa1d-d1083b8d928b service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] No waiting events found dispatching network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:55 user nova-compute[75203]: WARNING nova.compute.manager [req-d0bff439-bcc0-4b9d-be55-471353f15896 req-187390e7-b289-40e8-aa1d-d1083b8d928b service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received unexpected event network-vif-plugged-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 for instance with vm_state active and task_state deleting.
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Releasing lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Instance network_info: |[{"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Start _get_guest_xml network_info=[{"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:40:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:40:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-207108617',display_name='tempest-SnapshotDataIntegrityTests-server-207108617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-207108617',id=19,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCU0CpAWHbaSz3sHHi74KPTj0A0btntjHNwfHZnBt8gkX53k8K9QZx4//fAXu8pCSoBkym/5tyn0owGWG7C7pbMYDpjXiSJ0GbWF05qFa1mRhggs4Soz8MP6MYfMzrjcw==',key_name='tempest-keypair-720257294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90372eff92684a44a7d5a4f3c1583828',ramdisk_id='',reservation_id='r-58uo9h2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1392221729',owner_user_name='tempest-SnapshotDataIntegrityTests-1392221729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693208da309146e9ba35bd3fd123cd89',uuid=621d6e6b-cf0b-45fd-850e-3145f5687ab3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Converting VIF {"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e,network=Network(d9b2c16d-fbb7-46c0-a429-0031922cf5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3b3dcb-d3') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'pci_devices' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:40:55 user nova-compute[75203]:   <uuid>621d6e6b-cf0b-45fd-850e-3145f5687ab3</uuid>
Nov 28 18:40:55 user nova-compute[75203]:   <name>instance-00000013</name>
Nov 28 18:40:55 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:40:55 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:40:55 user nova-compute[75203]:   <metadata>
Nov 28 18:40:55 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:40:55 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-207108617</nova:name>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:40:55</nova:creationTime>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:40:55 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:40:55 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:owner>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:user uuid="693208da309146e9ba35bd3fd123cd89">tempest-SnapshotDataIntegrityTests-1392221729-project-member</nova:user>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:project uuid="90372eff92684a44a7d5a4f3c1583828">tempest-SnapshotDataIntegrityTests-1392221729</nova:project>
Nov 28 18:40:55 user nova-compute[75203]:       </nova:owner>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:ports>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:port uuid="3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e">
Nov 28 18:40:55 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 18:40:55 user nova-compute[75203]:         </nova:port>
Nov 28 18:40:55 user nova-compute[75203]:       </nova:ports>
Nov 28 18:40:55 user nova-compute[75203]:     </nova:instance>
Nov 28 18:40:55 user nova-compute[75203]:   </metadata>
Nov 28 18:40:55 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:40:55 user nova-compute[75203]:     <system>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="serial">621d6e6b-cf0b-45fd-850e-3145f5687ab3</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="uuid">621d6e6b-cf0b-45fd-850e-3145f5687ab3</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:40:55 user nova-compute[75203]:     </system>
Nov 28 18:40:55 user nova-compute[75203]:   </sysinfo>
Nov 28 18:40:55 user nova-compute[75203]:   <os>
Nov 28 18:40:55 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:40:55 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:40:55 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:40:55 user nova-compute[75203]:   </os>
Nov 28 18:40:55 user nova-compute[75203]:   <features>
Nov 28 18:40:55 user nova-compute[75203]:     <acpi/>
Nov 28 18:40:55 user nova-compute[75203]:     <apic/>
Nov 28 18:40:55 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:40:55 user nova-compute[75203]:   </features>
Nov 28 18:40:55 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:40:55 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:40:55 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:40:55 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:40:55 user nova-compute[75203]:   </clock>
Nov 28 18:40:55 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:40:55 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:40:55 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:40:55 user nova-compute[75203]:   </cpu>
Nov 28 18:40:55 user nova-compute[75203]:   <devices>
Nov 28 18:40:55 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:40:55 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:40:55 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk"/>
Nov 28 18:40:55 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:40:55 user nova-compute[75203]:     </disk>
Nov 28 18:40:55 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:40:55 user nova-compute[75203]:       <mac address="fa:16:3e:cd:aa:27"/>
Nov 28 18:40:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:40:55 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:40:55 user nova-compute[75203]:       <target dev="tap3a3b3dcb-d3"/>
Nov 28 18:40:55 user nova-compute[75203]:     </interface>
Nov 28 18:40:55 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:40:55 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/console.log" append="off"/>
Nov 28 18:40:55 user nova-compute[75203]:     </serial>
Nov 28 18:40:55 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:40:55 user nova-compute[75203]:     <video>
Nov 28 18:40:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:40:55 user nova-compute[75203]:     </video>
Nov 28 18:40:55 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:40:55 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:40:55 user nova-compute[75203]:     </rng>
Nov 28 18:40:55 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:40:55 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:40:55 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:40:55 user nova-compute[75203]:     </memballoon>
Nov 28 18:40:55 user nova-compute[75203]:   </devices>
Nov 28 18:40:55 user nova-compute[75203]: </domain>
Nov 28 18:40:55 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-207108617',display_name='tempest-SnapshotDataIntegrityTests-server-207108617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-207108617',id=19,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCU0CpAWHbaSz3sHHi74KPTj0A0btntjHNwfHZnBt8gkX53k8K9QZx4//fAXu8pCSoBkym/5tyn0owGWG7C7pbMYDpjXiSJ0GbWF05qFa1mRhggs4Soz8MP6MYfMzrjcw==',key_name='tempest-keypair-720257294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90372eff92684a44a7d5a4f3c1583828',ramdisk_id='',reservation_id='r-58uo9h2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1392221729',owner_user_name='tempest-SnapshotDataIntegrityTests-1392221729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693208da309146e9ba35bd3fd123cd89',uuid=621d6e6b-cf0b-45fd-850e-3145f5687ab3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Converting VIF {"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e,network=Network(d9b2c16d-fbb7-46c0-a429-0031922cf5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3b3dcb-d3') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG os_vif [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e,network=Network(d9b2c16d-fbb7-46c0-a429-0031922cf5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3b3dcb-d3') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dab0e37-e5c2-57b5-9f28-d9fc3da4373e', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a3b3dcb-d3, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a3b3dcb-d3, col_values=(('qos', UUID('4268474c-3bdb-47ee-bfaa-a6d06d8caafc')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a3b3dcb-d3, col_values=(('external_ids', {'iface-id': '3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:aa:27', 'vm-uuid': '621d6e6b-cf0b-45fd-850e-3145f5687ab3'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: INFO os_vif [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e,network=Network(d9b2c16d-fbb7-46c0-a429-0031922cf5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3b3dcb-d3')
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No VIF found with MAC fa:16:3e:cd:aa:27, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:55 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Deleted allocations for instance b44f50fc-d483-4a67-8fd1-7146a3d0adbd
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2f72550a-600d-46a7-ad62-1f677fcae4e3 tempest-VolumesAdminNegativeTest-1771058656 tempest-VolumesAdminNegativeTest-1771058656-project-member] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.361s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:55 user nova-compute[75203]: INFO nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 28 18:40:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b44f50fc-d483-4a67-8fd1-7146a3d0adbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-ae75b452-b0b8-4be2-bf6c-705e325da9d4 req-2251a04f-e88b-46f3-959f-06bd9939b215 service nova] [instance: b44f50fc-d483-4a67-8fd1-7146a3d0adbd] Received event network-vif-deleted-5718ecd4-ded7-4efb-84a1-a0cfe3fabef3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26532616365383330', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532616365383330', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-883710891',display_name='tempest-ServerActionsTestOtherA-server-474315397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-883710891',id=15,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxCc6vEhlAeiMgyKG6RNZ45Sr0UQX//i1sndSdsS4E5kd+SCD4AsLEHMeWVxO7Y//0/zPvjjBK6YosabO12NQfr0oUb4HQ9Yrce4dAJs7I43Ckntfds0dUck6EybhVqjA==',key_name='tempest-keypair-839735458',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:38:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-3rnm27ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=43538aa1-3ebe-4098-bd42-78353ed457ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:40:55 user nova-compute[75203]:   <uuid>43538aa1-3ebe-4098-bd42-78353ed457ce</uuid>
Nov 28 18:40:55 user nova-compute[75203]:   <name>instance-0000000f</name>
Nov 28 18:40:55 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:40:55 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:40:55 user nova-compute[75203]:   <metadata>
Nov 28 18:40:55 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:40:55 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:name>tempest-ServerActionsTestOtherA-server-474315397</nova:name>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:40:54</nova:creationTime>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:40:55 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:40:55 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:owner>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:user uuid="4b7ea4623ff14b2ea244c31ac84dd600">tempest-ServerActionsTestOtherA-1893596751-project-member</nova:user>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:project uuid="974923cb2e06473bbd8e4122888494df">tempest-ServerActionsTestOtherA-1893596751</nova:project>
Nov 28 18:40:55 user nova-compute[75203]:       </nova:owner>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:40:55 user nova-compute[75203]:       <nova:ports>
Nov 28 18:40:55 user nova-compute[75203]:         <nova:port uuid="a7fb7677-2bdc-4383-88b0-ba6caecb778a">
Nov 28 18:40:55 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:40:55 user nova-compute[75203]:         </nova:port>
Nov 28 18:40:55 user nova-compute[75203]:       </nova:ports>
Nov 28 18:40:55 user nova-compute[75203]:     </nova:instance>
Nov 28 18:40:55 user nova-compute[75203]:   </metadata>
Nov 28 18:40:55 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:40:55 user nova-compute[75203]:     <system>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="serial">43538aa1-3ebe-4098-bd42-78353ed457ce</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="uuid">43538aa1-3ebe-4098-bd42-78353ed457ce</entry>
Nov 28 18:40:55 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:40:55 user nova-compute[75203]:     </system>
Nov 28 18:40:55 user nova-compute[75203]:   </sysinfo>
Nov 28 18:40:55 user nova-compute[75203]:   <os>
Nov 28 18:40:55 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:40:55 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:40:55 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:40:55 user nova-compute[75203]:   </os>
Nov 28 18:40:55 user nova-compute[75203]:   <features>
Nov 28 18:40:55 user nova-compute[75203]:     <acpi/>
Nov 28 18:40:55 user nova-compute[75203]:     <apic/>
Nov 28 18:40:55 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:40:55 user nova-compute[75203]:   </features>
Nov 28 18:40:55 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:40:55 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:40:55 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:40:55 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:40:55 user nova-compute[75203]:   </clock>
Nov 28 18:40:55 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:40:55 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:40:55 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:40:55 user nova-compute[75203]:   </cpu>
Nov 28 18:40:55 user nova-compute[75203]:   <devices>
Nov 28 18:40:55 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:40:55 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:40:55 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk"/>
Nov 28 18:40:55 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:40:55 user nova-compute[75203]:     </disk>
Nov 28 18:40:55 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:40:55 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:40:55 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 18:40:55 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:40:55 user nova-compute[75203]:       <serial>8bf8ef1a-68e8-4348-95fd-16b892e29738</serial>
Nov 28 18:40:55 user nova-compute[75203]:     </disk>
Nov 28 18:40:55 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:40:55 user nova-compute[75203]:       <mac address="fa:16:3e:1a:23:1d"/>
Nov 28 18:40:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:40:55 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:40:55 user nova-compute[75203]:       <target dev="tapa7fb7677-2b"/>
Nov 28 18:40:55 user nova-compute[75203]:     </interface>
Nov 28 18:40:55 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:40:55 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/console.log" append="off"/>
Nov 28 18:40:55 user nova-compute[75203]:     </serial>
Nov 28 18:40:55 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:40:55 user nova-compute[75203]:     <video>
Nov 28 18:40:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:40:55 user nova-compute[75203]:     </video>
Nov 28 18:40:55 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:40:55 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:40:55 user nova-compute[75203]:     </rng>
Nov 28 18:40:55 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:40:55 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:40:55 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:40:55 user nova-compute[75203]:     </memballoon>
Nov 28 18:40:55 user nova-compute[75203]:   </devices>
Nov 28 18:40:55 user nova-compute[75203]: </domain>
Nov 28 18:40:55 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-883710891',display_name='tempest-ServerActionsTestOtherA-server-474315397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-883710891',id=15,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxCc6vEhlAeiMgyKG6RNZ45Sr0UQX//i1sndSdsS4E5kd+SCD4AsLEHMeWVxO7Y//0/zPvjjBK6YosabO12NQfr0oUb4HQ9Yrce4dAJs7I43Ckntfds0dUck6EybhVqjA==',key_name='tempest-keypair-839735458',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:38:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-3rnm27ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=43538aa1-3ebe-4098-bd42-78353ed457ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG os_vif [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2b88069-befb-59c5-8a3a-05d6fc0efe16', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7fb7677-2b, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7fb7677-2b, col_values=(('qos', UUID('faac140c-22e4-4f06-8017-95b1537cee5d')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7fb7677-2b, col_values=(('external_ids', {'iface-id': 'a7fb7677-2bdc-4383-88b0-ba6caecb778a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:23:1d', 'vm-uuid': '43538aa1-3ebe-4098-bd42-78353ed457ce'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:40:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:55 user nova-compute[75203]: INFO os_vif [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b')
Nov 28 18:40:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:40:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:40:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No VIF found with MAC fa:16:3e:1a:23:1d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:40:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-845d0428-79be-40bb-a490-ff9029b68e1f req-b7dee239-cb15-4b8c-87ac-03c342e36ee9 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-845d0428-79be-40bb-a490-ff9029b68e1f req-b7dee239-cb15-4b8c-87ac-03c342e36ee9 service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-845d0428-79be-40bb-a490-ff9029b68e1f req-b7dee239-cb15-4b8c-87ac-03c342e36ee9 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-845d0428-79be-40bb-a490-ff9029b68e1f req-b7dee239-cb15-4b8c-87ac-03c342e36ee9 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-845d0428-79be-40bb-a490-ff9029b68e1f req-b7dee239-cb15-4b8c-87ac-03c342e36ee9 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:57 user nova-compute[75203]: WARNING nova.compute.manager [req-845d0428-79be-40bb-a490-ff9029b68e1f req-b7dee239-cb15-4b8c-87ac-03c342e36ee9 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received unexpected event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with vm_state building and task_state spawning.
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-efd6d482-b7b8-4de8-a801-af723cd0a411 req-5329f32c-ca87-4e10-9d2c-95793312bdec service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-efd6d482-b7b8-4de8-a801-af723cd0a411 req-5329f32c-ca87-4e10-9d2c-95793312bdec service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-efd6d482-b7b8-4de8-a801-af723cd0a411 req-5329f32c-ca87-4e10-9d2c-95793312bdec service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-efd6d482-b7b8-4de8-a801-af723cd0a411 req-5329f32c-ca87-4e10-9d2c-95793312bdec service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-efd6d482-b7b8-4de8-a801-af723cd0a411 req-5329f32c-ca87-4e10-9d2c-95793312bdec service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:58 user nova-compute[75203]: WARNING nova.compute.manager [req-efd6d482-b7b8-4de8-a801-af723cd0a411 req-5329f32c-ca87-4e10-9d2c-95793312bdec service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received unexpected event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with vm_state active and task_state rebuild_spawning.
Nov 28 18:40:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:40:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-d5567dbc-1707-4b2e-bf83-d9e467e9eb0d req-de72051b-471d-46a6-81fb-7ce3fdcd5eda service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:40:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d5567dbc-1707-4b2e-bf83-d9e467e9eb0d req-de72051b-471d-46a6-81fb-7ce3fdcd5eda service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:40:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d5567dbc-1707-4b2e-bf83-d9e467e9eb0d req-de72051b-471d-46a6-81fb-7ce3fdcd5eda service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:40:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d5567dbc-1707-4b2e-bf83-d9e467e9eb0d req-de72051b-471d-46a6-81fb-7ce3fdcd5eda service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:40:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-d5567dbc-1707-4b2e-bf83-d9e467e9eb0d req-de72051b-471d-46a6-81fb-7ce3fdcd5eda service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:40:59 user nova-compute[75203]: WARNING nova.compute.manager [req-d5567dbc-1707-4b2e-bf83-d9e467e9eb0d req-de72051b-471d-46a6-81fb-7ce3fdcd5eda service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received unexpected event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with vm_state building and task_state spawning.
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:41:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Instance spawned successfully.
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:41:00 user nova-compute[75203]: INFO nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Took 8.70 seconds to spawn the instance on the hypervisor.
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:41:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance spawned successfully.
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:41:00 user nova-compute[75203]: INFO nova.compute.manager [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Took 9.68 seconds to build instance.
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-78d90fcc-d1cb-4641-8c74-0290e0c4f387 req-c8722ab9-bf39-4df9-94f7-0a887a7ad78f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-78d90fcc-d1cb-4641-8c74-0290e0c4f387 req-c8722ab9-bf39-4df9-94f7-0a887a7ad78f service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-78d90fcc-d1cb-4641-8c74-0290e0c4f387 req-c8722ab9-bf39-4df9-94f7-0a887a7ad78f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-78d90fcc-d1cb-4641-8c74-0290e0c4f387 req-c8722ab9-bf39-4df9-94f7-0a887a7ad78f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-78d90fcc-d1cb-4641-8c74-0290e0c4f387 req-c8722ab9-bf39-4df9-94f7-0a887a7ad78f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:00 user nova-compute[75203]: WARNING nova.compute.manager [req-78d90fcc-d1cb-4641-8c74-0290e0c4f387 req-c8722ab9-bf39-4df9-94f7-0a887a7ad78f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received unexpected event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with vm_state active and task_state rebuild_spawning.
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b82e181-61da-40be-b7d8-0e8fca367f66 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.781s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.240s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:00 user nova-compute[75203]: INFO nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75203) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c11-f003-4f75-b18a-3f4c8beb1db6 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:14 user nova-compute[75203]: INFO nova.compute.manager [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Terminating instance
Nov 28 18:41:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-b6254eb5-b551-4942-9eca-fcd0a9ab2b57 req-23a53bc8-49c5-4289-bf27-8c0a6defac77 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-unplugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b6254eb5-b551-4942-9eca-fcd0a9ab2b57 req-23a53bc8-49c5-4289-bf27-8c0a6defac77 service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b6254eb5-b551-4942-9eca-fcd0a9ab2b57 req-23a53bc8-49c5-4289-bf27-8c0a6defac77 service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b6254eb5-b551-4942-9eca-fcd0a9ab2b57 req-23a53bc8-49c5-4289-bf27-8c0a6defac77 service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-b6254eb5-b551-4942-9eca-fcd0a9ab2b57 req-23a53bc8-49c5-4289-bf27-8c0a6defac77 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-unplugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-b6254eb5-b551-4942-9eca-fcd0a9ab2b57 req-23a53bc8-49c5-4289-bf27-8c0a6defac77 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-unplugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:41:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Instance destroyed successfully.
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'resources' on Instance uuid 55c0f8b3-b64d-43d0-9245-730ee9f836fb {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:34:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-872100218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-872100218',id=4,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4nvbQKLZQHRXKnK4UKQ2N+ciJKLOfdYfF6uSAvLxkWJ4TI1FW+az8XSi54TcE8d2ZxjUPaFAgAgJumTuo0TPmO2dM7yE+IjdzwaqHTdjjZ++KmaUHb3+BF40h8hxTZuQ==',key_name='tempest-keypair-1052442870',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:38:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-bvmbn55f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=55c0f8b3-b64d-43d0-9245-730ee9f836fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "address": "fa:16:3e:c0:7c:67", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape926ef4f-c6", "ovs_interfaceid": "e926ef4f-c658-45e4-9a84-0368130c6bcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG os_vif [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape926ef4f-c6, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab5e6c7a-a197-4c09-aa13-25bd7b156b2a) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:41:15 user nova-compute[75203]: INFO os_vif [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7c:67,bridge_name='br-int',has_traffic_filtering=True,id=e926ef4f-c658-45e4-9a84-0368130c6bcb,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape926ef4f-c6')
Nov 28 18:41:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Deleting instance files /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb_del
Nov 28 18:41:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Deletion of /opt/stack/data/nova/instances/55c0f8b3-b64d-43d0-9245-730ee9f836fb_del complete
Nov 28 18:41:15 user nova-compute[75203]: INFO nova.compute.manager [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 28 18:41:15 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:41:15 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:41:16 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:41:16 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Took 0.97 seconds to deallocate network for instance.
Nov 28 18:41:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7fd4355-ee3b-4116-aa0a-d903b7d32ceb req-e14b5ab9-7092-4046-8caf-d06293a6c671 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-deleted-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:16 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:41:16 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:41:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:17 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Deleted allocations for instance 55c0f8b3-b64d-43d0-9245-730ee9f836fb
Nov 28 18:41:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-99abb66b-e8be-4e81-bb8d-e4dc98fc6b3a req-ef7d7f15-cadd-43f6-a7f7-18df4eda4532 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-99abb66b-e8be-4e81-bb8d-e4dc98fc6b3a req-ef7d7f15-cadd-43f6-a7f7-18df4eda4532 service nova] Acquiring lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-99abb66b-e8be-4e81-bb8d-e4dc98fc6b3a req-ef7d7f15-cadd-43f6-a7f7-18df4eda4532 service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-99abb66b-e8be-4e81-bb8d-e4dc98fc6b3a req-ef7d7f15-cadd-43f6-a7f7-18df4eda4532 service nova] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-99abb66b-e8be-4e81-bb8d-e4dc98fc6b3a req-ef7d7f15-cadd-43f6-a7f7-18df4eda4532 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] No waiting events found dispatching network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:17 user nova-compute[75203]: WARNING nova.compute.manager [req-99abb66b-e8be-4e81-bb8d-e4dc98fc6b3a req-ef7d7f15-cadd-43f6-a7f7-18df4eda4532 service nova] [instance: 55c0f8b3-b64d-43d0-9245-730ee9f836fb] Received unexpected event network-vif-plugged-e926ef4f-c658-45e4-9a84-0368130c6bcb for instance with vm_state deleted and task_state None.
Nov 28 18:41:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9fe06ae7-04f6-47d2-ada9-0f46a05fbce2 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "55c0f8b3-b64d-43d0-9245-730ee9f836fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.475s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:19 user nova-compute[75203]: INFO nova.compute.manager [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Detaching volume 279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:41:19 user nova-compute[75203]: INFO nova.virt.block_device [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Attempting to driver detach volume 279129b2-2b52-490d-9664-6c6ea206321d from mountpoint /dev/vdb
Nov 28 18:41:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Attempting to detach device vdb from instance eec19476-5b8e-4d91-b0e3-6ecd0986632d from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:41:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:41:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:41:19 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:41:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:41:19 user nova-compute[75203]:   <serial>279129b2-2b52-490d-9664-6c6ea206321d</serial>
Nov 28 18:41:19 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:41:19 user nova-compute[75203]: </disk>
Nov 28 18:41:19 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:41:19 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Successfully detached device vdb from instance eec19476-5b8e-4d91-b0e3-6ecd0986632d from the persistent domain config.
Nov 28 18:41:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eec19476-5b8e-4d91-b0e3-6ecd0986632d from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:41:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:41:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:41:19 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:41:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:41:19 user nova-compute[75203]:   <serial>279129b2-2b52-490d-9664-6c6ea206321d</serial>
Nov 28 18:41:19 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:41:19 user nova-compute[75203]: </disk>
Nov 28 18:41:19 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:41:19 user nova-compute[75203]: INFO nova.compute.manager [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Unrescuing
Nov 28 18:41:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:41:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:41:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:41:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'flavor' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-6669852a-7e57-4d7e-af2b-55609281300b req-90655d99-a009-4183-936a-3d26c5235834 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6669852a-7e57-4d7e-af2b-55609281300b req-90655d99-a009-4183-936a-3d26c5235834 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6669852a-7e57-4d7e-af2b-55609281300b req-90655d99-a009-4183-936a-3d26c5235834 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6669852a-7e57-4d7e-af2b-55609281300b req-90655d99-a009-4183-936a-3d26c5235834 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-6669852a-7e57-4d7e-af2b-55609281300b req-90655d99-a009-4183-936a-3d26c5235834 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:20 user nova-compute[75203]: WARNING nova.compute.manager [req-6669852a-7e57-4d7e-af2b-55609281300b req-90655d99-a009-4183-936a-3d26c5235834 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:41:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance destroyed successfully.
Nov 28 18:41:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:22 user nova-compute[75203]: WARNING nova.compute.manager [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:41:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:22 user nova-compute[75203]: WARNING nova.compute.manager [req-5611d32a-6c38-4cf2-979a-eea6d66fec1d req-d1ab5cfe-24a1-4822-a5eb-9e5efc3ec844 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:41:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1c408be1-0769-4703-89fc-0a77d285bf78 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:41:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0f9c886-fe5c-4d1b-9cfb-cf1077b1c451 req-bcc9ddb6-b91b-48cb-83c4-8867107552d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0f9c886-fe5c-4d1b-9cfb-cf1077b1c451 req-bcc9ddb6-b91b-48cb-83c4-8867107552d5 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0f9c886-fe5c-4d1b-9cfb-cf1077b1c451 req-bcc9ddb6-b91b-48cb-83c4-8867107552d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0f9c886-fe5c-4d1b-9cfb-cf1077b1c451 req-bcc9ddb6-b91b-48cb-83c4-8867107552d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0f9c886-fe5c-4d1b-9cfb-cf1077b1c451 req-bcc9ddb6-b91b-48cb-83c4-8867107552d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:24 user nova-compute[75203]: WARNING nova.compute.manager [req-f0f9c886-fe5c-4d1b-9cfb-cf1077b1c451 req-bcc9ddb6-b91b-48cb-83c4-8867107552d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state active and task_state None.
Nov 28 18:41:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG nova.compute.manager [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-changed-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG nova.compute.manager [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Refreshing instance network info cache due to event network-changed-96f2c936-b17c-4576-88e3-bceabf0d612b. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] Acquiring lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] Acquired lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG nova.network.neutron [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Refreshing network info cache for port 96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG nova.network.neutron [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Updated VIF entry in instance network info cache for port 96f2c936-b17c-4576-88e3-bceabf0d612b. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG nova.network.neutron [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Updating instance_info_cache with network_info: [{"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:41:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-33fc086d-93e7-4599-a2aa-e31538320436 req-6801a53c-94b2-487f-a49f-be6a5b090453 service nova] Releasing lock "refresh_cache-1a74de08-00b4-4fde-b1df-0af9ab5001b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:41:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG nova.objects.instance [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lazy-loading 'flavor' on Instance uuid 1a74de08-00b4-4fde-b1df-0af9ab5001b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:32 user nova-compute[75203]: INFO nova.compute.manager [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Attaching volume 1fb2f79d-600f-4394-a236-a118644fabb2 to /dev/sdc
Nov 28 18:41:32 user nova-compute[75203]: DEBUG os_brick.utils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d132a-3532-490a-a4dc-0697efd89d10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c5a878-f21e-4863-a304-a6f19994b4e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567b0ce-b3ea-45fe-8be8-68ed54e8ed1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602eeb6-bd7b-4485-af33-1683ac707df5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:41:32 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:41:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc92200e-76aa-47c5-8f82-e4a5396e654b]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG os_brick.utils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Updating existing volume attachment record: b20afc95-82b7-490f-9eee-a457cc95d099 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:41:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:39 user nova-compute[75203]: INFO nova.compute.manager [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Terminating instance
Nov 28 18:41:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-c21fe8fe-c923-4419-a95a-b6878d34cc43 req-7b32d9a1-9c9c-4c12-9cdc-f8c8721d933f service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received event network-vif-unplugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c21fe8fe-c923-4419-a95a-b6878d34cc43 req-7b32d9a1-9c9c-4c12-9cdc-f8c8721d933f service nova] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c21fe8fe-c923-4419-a95a-b6878d34cc43 req-7b32d9a1-9c9c-4c12-9cdc-f8c8721d933f service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c21fe8fe-c923-4419-a95a-b6878d34cc43 req-7b32d9a1-9c9c-4c12-9cdc-f8c8721d933f service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-c21fe8fe-c923-4419-a95a-b6878d34cc43 req-7b32d9a1-9c9c-4c12-9cdc-f8c8721d933f service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] No waiting events found dispatching network-vif-unplugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-c21fe8fe-c923-4419-a95a-b6878d34cc43 req-7b32d9a1-9c9c-4c12-9cdc-f8c8721d933f service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received event network-vif-unplugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:39 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eec19476-5b8e-4d91-b0e3-6ecd0986632d is timed out.
Nov 28 18:41:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Successfully detached device vdb from instance eec19476-5b8e-4d91-b0e3-6ecd0986632d from the live domain config.
Nov 28 18:41:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhlceikj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:41:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b467d99a-2c6e-4481-87ee-ee9a371e95e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:41:39 user nova-compute[75203]: No targets found.
Nov 28 18:41:39 user nova-compute[75203]: iSNS:
Nov 28 18:41:39 user nova-compute[75203]: No targets found.
Nov 28 18:41:39 user nova-compute[75203]: STATIC:
Nov 28 18:41:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738
Nov 28 18:41:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:41:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:41:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d
Nov 28 18:41:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:41:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:41:39 user nova-compute[75203]: FIRMWARE:
Nov 28 18:41:39 user nova-compute[75203]: No targets found.
Nov 28 18:41:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:41:39 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:41:39 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb1c51-75ca-48af-8fd9-345bfe1aff95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be685f-8a31-4ce3-b85e-9d89508b656c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:41:39 user nova-compute[75203]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:41:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d (non-flash)
Nov 28 18:41:39 user nova-compute[75203]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:41:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07902a3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d'): ({'sdf'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Removing single pathed devices sdf {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeb0f41-c6c9-45a7-aab2-28f8aa19f0a1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439b4e9-0a33-4763-a9b6-b91a7ef734c7]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Flushing IO for device /dev/sdf {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee044ff-1a90-41c4-9597-fc35b629e1f6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:41:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[817df8f1-a779-49e9-ba5a-f5a48f276da8]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Instance destroyed successfully.
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.objects.instance [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lazy-loading 'resources' on Instance uuid 7075cd97-3bc9-4846-bf86-8ba9da8519ad {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[800135f9-b93c-4c26-ad4b-b0ea1364d9d5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2000795404',display_name='tempest-ServersNegativeTestJSON-server-2000795404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2000795404',id=17,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:39:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e89044cd2ec4716af0b204c9b107772',ramdisk_id='',reservation_id='r-9jyo8i3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-617619106',owner_user_name='tempest-ServersNegativeTestJSON-617619106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:39:57Z,user_data=None,user_id='72568e67e6f34f6584962ffea5d48f6f',uuid=7075cd97-3bc9-4846-bf86-8ba9da8519ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converting VIF {"id": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "address": "fa:16:3e:78:0a:9c", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa83a4da3-9a", "ovs_interfaceid": "a83a4da3-9a92-488d-8643-3a4312bf13f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:9c,bridge_name='br-int',has_traffic_filtering=True,id=a83a4da3-9a92-488d-8643-3a4312bf13f0,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83a4da3-9a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_vif [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:9c,bridge_name='br-int',has_traffic_filtering=True,id=a83a4da3-9a92-488d-8643-3a4312bf13f0,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83a4da3-9a') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa83a4da3-9a, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08c95bdc-74d5-49e5-8228-d83081b25679) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:40 user nova-compute[75203]: INFO os_vif [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0a:9c,bridge_name='br-int',has_traffic_filtering=True,id=a83a4da3-9a92-488d-8643-3a4312bf13f0,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa83a4da3-9a')
Nov 28 18:41:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Deleting instance files /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad_del
Nov 28 18:41:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Deletion of /opt/stack/data/nova/instances/7075cd97-3bc9-4846-bf86-8ba9da8519ad_del complete
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3556b349-e0f9-4ecf-a8e8-edcfedb3efb5]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260]
Nov 28 18:41:40 user nova-compute[75203]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d, portal: 172.16.0.220,3260] successful.
Nov 28 18:41:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:279129b2-2b52-490d-9664-6c6ea206321d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa13578-d767-499f-8758-3f3ccbba969a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] <== disconnect_volume: return (309ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:41:40 user nova-compute[75203]: INFO nova.compute.manager [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRXPMsHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:41:40 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:41:40 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:41:40 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a4c177-e15c-4539-860a-65394385af32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:41:40 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db332ad-1cbe-4bc0-9e96-5fe87938180c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2] added
Nov 28 18:41:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b45ac-3a9a-4e4f-8110-3d012e4e2be4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1510f2fa-0cc2-4ff7-8538-20db6f5ecff2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRXPMsHN {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRXPMsHN" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3ce793-d54a-472e-874d-7346a598f466]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRXPMsHN'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e317d34-b085-4bf0-b572-4a0ed6079906]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5275f-864a-45d6-ad52-3132c9f2e329]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:41:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:41:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5263121-9d40-40b6-9f60-1da1f1fa5010]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260]
Nov 28 18:41:40 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260] successful.
Nov 28 18:41:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d1996-28ce-4b6a-95fe-6fb07e0fa319]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac6624-6bd2-4787-a6e1-435910a8a77f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:41:40 user nova-compute[75203]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 (non-flash)
Nov 28 18:41:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:41:40 user nova-compute[75203]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 (non-flash)
Nov 28 18:41:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[75117fbb-64bc-4d4f-86d9-e5419f13bf11]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRXPMsHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:41:40 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Took 0.63 seconds to deallocate network for instance.
Nov 28 18:41:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-363bf388-e3b1-4277-be5b-be048869d28a req-b5094b79-9705-4148-aa9c-2710ab34ed2e service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received event network-vif-deleted-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lazy-loading 'flavor' on Instance uuid eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d7b92648-c854-4f63-b8f0-ba2c20efbd61 tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.885s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:41 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Deleted allocations for instance 7075cd97-3bc9-4846-bf86-8ba9da8519ad
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-260a1fcf-4231-4205-a543-60479583fe02 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.168s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-fc42eba0-a0e3-4235-9fa0-3a6fb112d396 req-8336c3ca-acbb-4ad0-b164-00cfef733224 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received event network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fc42eba0-a0e3-4235-9fa0-3a6fb112d396 req-8336c3ca-acbb-4ad0-b164-00cfef733224 service nova] Acquiring lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fc42eba0-a0e3-4235-9fa0-3a6fb112d396 req-8336c3ca-acbb-4ad0-b164-00cfef733224 service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fc42eba0-a0e3-4235-9fa0-3a6fb112d396 req-8336c3ca-acbb-4ad0-b164-00cfef733224 service nova] Lock "7075cd97-3bc9-4846-bf86-8ba9da8519ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-fc42eba0-a0e3-4235-9fa0-3a6fb112d396 req-8336c3ca-acbb-4ad0-b164-00cfef733224 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] No waiting events found dispatching network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:41:41 user nova-compute[75203]: WARNING nova.compute.manager [req-fc42eba0-a0e3-4235-9fa0-3a6fb112d396 req-8336c3ca-acbb-4ad0-b164-00cfef733224 service nova] [instance: 7075cd97-3bc9-4846-bf86-8ba9da8519ad] Received unexpected event network-vif-plugged-a83a4da3-9a92-488d-8643-3a4312bf13f0 for instance with vm_state deleted and task_state None.
Nov 28 18:41:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23537346338353939', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537346338353939', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.objects.instance [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lazy-loading 'flavor' on Instance uuid 1a74de08-00b4-4fde-b1df-0af9ab5001b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:41:41 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:41:41 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:41:41 user nova-compute[75203]:   <target dev="sdc" bus="scsi"/>
Nov 28 18:41:41 user nova-compute[75203]:   <serial>1fb2f79d-600f-4394-a236-a118644fabb2</serial>
Nov 28 18:41:41 user nova-compute[75203]:   <address type="drive" controller="0" unit="2"/>
Nov 28 18:41:41 user nova-compute[75203]: </disk>
Nov 28 18:41:41 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] No BDM found with device name sda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] No VIF found with MAC fa:16:3e:6b:bc:a0, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3ba24c33-8cf1-454b-b186-3b75ce524573 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.679s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:43 user nova-compute[75203]: INFO nova.compute.manager [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Detaching volume 1fb2f79d-600f-4394-a236-a118644fabb2
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:44 user nova-compute[75203]: INFO nova.virt.block_device [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Attempting to driver detach volume 1fb2f79d-600f-4394-a236-a118644fabb2 from mountpoint /dev/sdc
Nov 28 18:41:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Attempting to detach device sdc from instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:41:44 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:41:44 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:41:44 user nova-compute[75203]:   <target dev="sdc" bus="scsi"/>
Nov 28 18:41:44 user nova-compute[75203]:   <serial>1fb2f79d-600f-4394-a236-a118644fabb2</serial>
Nov 28 18:41:44 user nova-compute[75203]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 18:41:44 user nova-compute[75203]: </disk>
Nov 28 18:41:44 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:41:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Successfully detached device sdc from instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 from the persistent domain config.
Nov 28 18:41:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:41:44 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:41:44 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:41:44 user nova-compute[75203]:   <target dev="sdc" bus="scsi"/>
Nov 28 18:41:44 user nova-compute[75203]:   <serial>1fb2f79d-600f-4394-a236-a118644fabb2</serial>
Nov 28 18:41:44 user nova-compute[75203]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 28 18:41:44 user nova-compute[75203]: </disk>
Nov 28 18:41:44 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:47 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:41:47 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=25.197650909423828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance eec19476-5b8e-4d91-b0e3-6ecd0986632d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43538aa1-3ebe-4098-bd42-78353ed457ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:47 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:41:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:41:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.831s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-changed-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:41:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Refreshing instance network info cache due to event network-changed-51986925-f22e-4528-b519-836232111180. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:41:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:41:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:41:49 user nova-compute[75203]: DEBUG nova.network.neutron [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Refreshing network info cache for port 51986925-f22e-4528-b519-836232111180 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:41:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:50 user nova-compute[75203]: DEBUG nova.network.neutron [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updated VIF entry in instance network info cache for port 51986925-f22e-4528-b519-836232111180. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:41:50 user nova-compute[75203]: DEBUG nova.network.neutron [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:41:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-356f9ab8-e577-40c0-a780-63286572ae53 req-83f9f427-3e72-48f1-a75f-256ae875e751 service nova] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:41:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:41:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:41:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 18:41:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:41:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e170916d-ac84-400b-96b6-62d4b5919980" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:41:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:58 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:41:58 user nova-compute[75203]: INFO nova.compute.claims [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Claim successful on node user
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:41:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.policy [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad9a9772df954da0b42b5b102440c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1aaec341d441fb4da4fc53a985617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:41:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Creating image(s)
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "/opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk 1073741824" returned: 0 in 0.055s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:41:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Successfully created port: 415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Cannot resize image /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Ensure instance console log exists: /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Successfully updated port: 415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received event network-changed-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Refreshing instance network info cache due to event network-changed-415ec5d9-72d2-41e9-857c-a9f8b5058196. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:42:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] Acquiring lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Instance network_info: |[{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] Acquired lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Refreshing network info cache for port 415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Start _get_guest_xml network_info=[{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:42:01 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:42:01 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-960714552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-960714552',id=20,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-0m8uorp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:41:59Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=e170916d-ac84-400b-96b6-62d4b5919980,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=415ec5d9-72d2-41e9-857c-a9f8b5058196,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415ec5d9-72') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.objects.instance [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'pci_devices' on Instance uuid e170916d-ac84-400b-96b6-62d4b5919980 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:42:01 user nova-compute[75203]:   <uuid>e170916d-ac84-400b-96b6-62d4b5919980</uuid>
Nov 28 18:42:01 user nova-compute[75203]:   <name>instance-00000014</name>
Nov 28 18:42:01 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:42:01 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:42:01 user nova-compute[75203]:   <metadata>
Nov 28 18:42:01 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:42:01 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:42:01 user nova-compute[75203]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-960714552</nova:name>
Nov 28 18:42:01 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:42:01</nova:creationTime>
Nov 28 18:42:01 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:42:01 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:42:01 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:42:01 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:42:01 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:42:01 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:42:01 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:42:01 user nova-compute[75203]:       <nova:owner>
Nov 28 18:42:01 user nova-compute[75203]:         <nova:user uuid="ad9a9772df954da0b42b5b102440c1d0">tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member</nova:user>
Nov 28 18:42:01 user nova-compute[75203]:         <nova:project uuid="eec1aaec341d441fb4da4fc53a985617">tempest-ServerBootFromVolumeStableRescueTest-1173209255</nova:project>
Nov 28 18:42:01 user nova-compute[75203]:       </nova:owner>
Nov 28 18:42:01 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:42:01 user nova-compute[75203]:       <nova:ports>
Nov 28 18:42:01 user nova-compute[75203]:         <nova:port uuid="415ec5d9-72d2-41e9-857c-a9f8b5058196">
Nov 28 18:42:01 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:42:01 user nova-compute[75203]:         </nova:port>
Nov 28 18:42:01 user nova-compute[75203]:       </nova:ports>
Nov 28 18:42:01 user nova-compute[75203]:     </nova:instance>
Nov 28 18:42:01 user nova-compute[75203]:   </metadata>
Nov 28 18:42:01 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:42:01 user nova-compute[75203]:     <system>
Nov 28 18:42:01 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:42:01 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:42:01 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:42:01 user nova-compute[75203]:       <entry name="serial">e170916d-ac84-400b-96b6-62d4b5919980</entry>
Nov 28 18:42:01 user nova-compute[75203]:       <entry name="uuid">e170916d-ac84-400b-96b6-62d4b5919980</entry>
Nov 28 18:42:01 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:42:01 user nova-compute[75203]:     </system>
Nov 28 18:42:01 user nova-compute[75203]:   </sysinfo>
Nov 28 18:42:01 user nova-compute[75203]:   <os>
Nov 28 18:42:01 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:42:01 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:42:01 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:42:01 user nova-compute[75203]:   </os>
Nov 28 18:42:01 user nova-compute[75203]:   <features>
Nov 28 18:42:01 user nova-compute[75203]:     <acpi/>
Nov 28 18:42:01 user nova-compute[75203]:     <apic/>
Nov 28 18:42:01 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:42:01 user nova-compute[75203]:   </features>
Nov 28 18:42:01 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:42:01 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:42:01 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:42:01 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:42:01 user nova-compute[75203]:   </clock>
Nov 28 18:42:01 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:42:01 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:42:01 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:42:01 user nova-compute[75203]:   </cpu>
Nov 28 18:42:01 user nova-compute[75203]:   <devices>
Nov 28 18:42:01 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:42:01 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:42:01 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk"/>
Nov 28 18:42:01 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:42:01 user nova-compute[75203]:     </disk>
Nov 28 18:42:01 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:42:01 user nova-compute[75203]:       <mac address="fa:16:3e:38:1d:b3"/>
Nov 28 18:42:01 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:42:01 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:42:01 user nova-compute[75203]:       <target dev="tap415ec5d9-72"/>
Nov 28 18:42:01 user nova-compute[75203]:     </interface>
Nov 28 18:42:01 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:42:01 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/console.log" append="off"/>
Nov 28 18:42:01 user nova-compute[75203]:     </serial>
Nov 28 18:42:01 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:42:01 user nova-compute[75203]:     <video>
Nov 28 18:42:01 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:42:01 user nova-compute[75203]:     </video>
Nov 28 18:42:01 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:42:01 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:42:01 user nova-compute[75203]:     </rng>
Nov 28 18:42:01 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:42:01 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:42:01 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:42:01 user nova-compute[75203]:     </memballoon>
Nov 28 18:42:01 user nova-compute[75203]:   </devices>
Nov 28 18:42:01 user nova-compute[75203]: </domain>
Nov 28 18:42:01 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-960714552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-960714552',id=20,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-0m8uorp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:41:59Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=e170916d-ac84-400b-96b6-62d4b5919980,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=415ec5d9-72d2-41e9-857c-a9f8b5058196,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415ec5d9-72') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG os_vif [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=415ec5d9-72d2-41e9-857c-a9f8b5058196,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415ec5d9-72') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73332f44-691f-51ba-b0d5-91226fcf4e90', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap415ec5d9-72, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap415ec5d9-72, col_values=(('qos', UUID('10d41ff9-26d7-4bdd-a9db-deb53f5fbe72')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap415ec5d9-72, col_values=(('external_ids', {'iface-id': '415ec5d9-72d2-41e9-857c-a9f8b5058196', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:1d:b3', 'vm-uuid': 'e170916d-ac84-400b-96b6-62d4b5919980'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:01 user nova-compute[75203]: INFO os_vif [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=415ec5d9-72d2-41e9-857c-a9f8b5058196,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415ec5d9-72')
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No VIF found with MAC fa:16:3e:38:1d:b3, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updated VIF entry in instance network info cache for port 415ec5d9-72d2-41e9-857c-a9f8b5058196. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0357b771-e8de-4fa7-b69d-4941dc9c7e27 req-ed5b85e0-6fa4-410e-a746-f6c7b76805b6 service nova] Releasing lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-b886cb48-628b-40c1-90e1-c0354699f19a req-44685a99-ed14-40c6-970c-f6bb3ceec915 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received event network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b886cb48-628b-40c1-90e1-c0354699f19a req-44685a99-ed14-40c6-970c-f6bb3ceec915 service nova] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b886cb48-628b-40c1-90e1-c0354699f19a req-44685a99-ed14-40c6-970c-f6bb3ceec915 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b886cb48-628b-40c1-90e1-c0354699f19a req-44685a99-ed14-40c6-970c-f6bb3ceec915 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-b886cb48-628b-40c1-90e1-c0354699f19a req-44685a99-ed14-40c6-970c-f6bb3ceec915 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] No waiting events found dispatching network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:02 user nova-compute[75203]: WARNING nova.compute.manager [req-b886cb48-628b-40c1-90e1-c0354699f19a req-44685a99-ed14-40c6-970c-f6bb3ceec915 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received unexpected event network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 for instance with vm_state building and task_state spawning.
Nov 28 18:42:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:04 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 is timed out.
Nov 28 18:42:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Successfully detached device sdc from instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0 from the live domain config.
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRXPMsHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:42:04 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e23de00-18ef-447a-bae0-d50b7739800e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:42:04 user nova-compute[75203]: No targets found.
Nov 28 18:42:04 user nova-compute[75203]: iSNS:
Nov 28 18:42:04 user nova-compute[75203]: No targets found.
Nov 28 18:42:04 user nova-compute[75203]: STATIC:
Nov 28 18:42:04 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2
Nov 28 18:42:04 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:42:04 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:42:04 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738
Nov 28 18:42:04 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:42:04 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:42:04 user nova-compute[75203]: FIRMWARE:
Nov 28 18:42:04 user nova-compute[75203]: No targets found.
Nov 28 18:42:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:42:04 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:42:04 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1876f09-4f83-445f-8d2a-6851e6dcc1cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e4c26c-0534-4a9e-8564-6fdb592db463]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:42:04 user nova-compute[75203]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 (non-flash)
Nov 28 18:42:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:42:04 user nova-compute[75203]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 (non-flash)
Nov 28 18:42:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07902a24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[804cfc2d-0510-495c-8e0f-1b2171712284]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3717fd6-c7db-4a23-bedb-ff3b3891f8fa]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbf4506-61d1-450b-83af-1b03e6696fc2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e95003-a2f9-41bf-8929-f6a38278e3e5]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c297a49-f659-47e7-97a8-aab88d872caf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d703328-11da-40f9-ae55-10bd7fafbc3a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260]
Nov 28 18:42:04 user nova-compute[75203]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2, portal: 172.16.0.220,3260] successful.
Nov 28 18:42:04 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fb2f79d-600f-4394-a236-a118644fabb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[531db1e7-854c-4303-8da8-5651feec1344]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] <== disconnect_volume: return (278ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:42:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Instance spawned successfully.
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:05 user nova-compute[75203]: INFO nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 28 18:42:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:42:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-0e5260b0-f9b5-4ca8-a75b-36d14423dd52 req-631665bd-bb19-48f6-8d60-866a18fe0d81 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received event network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0e5260b0-f9b5-4ca8-a75b-36d14423dd52 req-631665bd-bb19-48f6-8d60-866a18fe0d81 service nova] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0e5260b0-f9b5-4ca8-a75b-36d14423dd52 req-631665bd-bb19-48f6-8d60-866a18fe0d81 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0e5260b0-f9b5-4ca8-a75b-36d14423dd52 req-631665bd-bb19-48f6-8d60-866a18fe0d81 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-0e5260b0-f9b5-4ca8-a75b-36d14423dd52 req-631665bd-bb19-48f6-8d60-866a18fe0d81 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] No waiting events found dispatching network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:05 user nova-compute[75203]: WARNING nova.compute.manager [req-0e5260b0-f9b5-4ca8-a75b-36d14423dd52 req-631665bd-bb19-48f6-8d60-866a18fe0d81 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received unexpected event network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 for instance with vm_state building and task_state spawning.
Nov 28 18:42:05 user nova-compute[75203]: INFO nova.compute.manager [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Took 6.45 seconds to build instance.
Nov 28 18:42:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8ce913d3-acb4-4ce6-910f-02eebd5f2cd2 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e170916d-ac84-400b-96b6-62d4b5919980" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.548s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:05 user nova-compute[75203]: DEBUG nova.objects.instance [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lazy-loading 'flavor' on Instance uuid 1a74de08-00b4-4fde-b1df-0af9ab5001b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-72f55d9f-1d53-46c2-a716-25bb43dd4f5d tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.697s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:06 user nova-compute[75203]: INFO nova.compute.manager [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Terminating instance
Nov 28 18:42:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-77dd61fb-9fc9-4372-936f-5e8b5ebbb05e req-02f55dad-652c-47f9-93bc-8f3b4a38d52e service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-vif-unplugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77dd61fb-9fc9-4372-936f-5e8b5ebbb05e req-02f55dad-652c-47f9-93bc-8f3b4a38d52e service nova] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77dd61fb-9fc9-4372-936f-5e8b5ebbb05e req-02f55dad-652c-47f9-93bc-8f3b4a38d52e service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77dd61fb-9fc9-4372-936f-5e8b5ebbb05e req-02f55dad-652c-47f9-93bc-8f3b4a38d52e service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-77dd61fb-9fc9-4372-936f-5e8b5ebbb05e req-02f55dad-652c-47f9-93bc-8f3b4a38d52e service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] No waiting events found dispatching network-vif-unplugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-77dd61fb-9fc9-4372-936f-5e8b5ebbb05e req-02f55dad-652c-47f9-93bc-8f3b4a38d52e service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-vif-unplugged-96f2c936-b17c-4576-88e3-bceabf0d612b for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:42:07 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Instance destroyed successfully.
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.objects.instance [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lazy-loading 'resources' on Instance uuid 1a74de08-00b4-4fde-b1df-0af9ab5001b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:39:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-103806647',display_name='tempest-AttachSCSIVolumeTestJSON-server-103806647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-103806647',id=16,image_ref='679ccc27-04ab-4552-8dc0-be4b06daf258',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbWqCaByOWIC3Lp+ogJb9rMViXkQ6Wl58OGHo3Ip5VA6E8w4wILIZuFFAeLgFkwhyU6qfJZneeg62pLIv906vQfHnXdHlI7wB7H5qnN5kMhLWu3gwEpNAMjP9stFqwUjQ==',key_name='tempest-keypair-1357937852',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e94875ddb5214ab6868b5e1c8e2d808e',ramdisk_id='',reservation_id='r-dnm6aha6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='679ccc27-04ab-4552-8dc0-be4b06daf258',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-453690146',owner_user_name='tempest-AttachSCSIVolumeTestJSON-453690146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:39:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be936df829fd467e9905758c55d5cb19',uuid=1a74de08-00b4-4fde-b1df-0af9ab5001b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Converting VIF {"id": "96f2c936-b17c-4576-88e3-bceabf0d612b", "address": "fa:16:3e:6b:bc:a0", "network": {"id": "cf2d5c11-12bc-471b-b75a-c6f68db4e31f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1871898569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e94875ddb5214ab6868b5e1c8e2d808e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2c936-b1", "ovs_interfaceid": "96f2c936-b17c-4576-88e3-bceabf0d612b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:bc:a0,bridge_name='br-int',has_traffic_filtering=True,id=96f2c936-b17c-4576-88e3-bceabf0d612b,network=Network(cf2d5c11-12bc-471b-b75a-c6f68db4e31f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2c936-b1') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG os_vif [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:bc:a0,bridge_name='br-int',has_traffic_filtering=True,id=96f2c936-b17c-4576-88e3-bceabf0d612b,network=Network(cf2d5c11-12bc-471b-b75a-c6f68db4e31f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2c936-b1') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96f2c936-b1, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bb5220c-0186-481d-a08f-4e7c3ba91d47) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:07 user nova-compute[75203]: INFO os_vif [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:bc:a0,bridge_name='br-int',has_traffic_filtering=True,id=96f2c936-b17c-4576-88e3-bceabf0d612b,network=Network(cf2d5c11-12bc-471b-b75a-c6f68db4e31f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2c936-b1')
Nov 28 18:42:07 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Deleting instance files /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0_del
Nov 28 18:42:07 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Deletion of /opt/stack/data/nova/instances/1a74de08-00b4-4fde-b1df-0af9ab5001b0_del complete
Nov 28 18:42:07 user nova-compute[75203]: INFO nova.compute.manager [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 28 18:42:07 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:42:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:08 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:08 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Took 1.07 seconds to deallocate network for instance.
Nov 28 18:42:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-ede2a2ab-0e60-49bb-97ee-070052114ef3 req-4c0abafd-bb57-438b-b3a2-26d26789192a service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-vif-deleted-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.165s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:42:09 user nova-compute[75203]: INFO nova.compute.claims [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Claim successful on node user
Nov 28 18:42:09 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Deleted allocations for instance 1a74de08-00b4-4fde-b1df-0af9ab5001b0
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-de703689-dada-411d-9fe2-30cc01fc417b req-4c15c9ef-cb8e-443a-a4c5-21d1eff0dad5 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received event network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de703689-dada-411d-9fe2-30cc01fc417b req-4c15c9ef-cb8e-443a-a4c5-21d1eff0dad5 service nova] Acquiring lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de703689-dada-411d-9fe2-30cc01fc417b req-4c15c9ef-cb8e-443a-a4c5-21d1eff0dad5 service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de703689-dada-411d-9fe2-30cc01fc417b req-4c15c9ef-cb8e-443a-a4c5-21d1eff0dad5 service nova] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-de703689-dada-411d-9fe2-30cc01fc417b req-4c15c9ef-cb8e-443a-a4c5-21d1eff0dad5 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] No waiting events found dispatching network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:09 user nova-compute[75203]: WARNING nova.compute.manager [req-de703689-dada-411d-9fe2-30cc01fc417b req-4c15c9ef-cb8e-443a-a4c5-21d1eff0dad5 service nova] [instance: 1a74de08-00b4-4fde-b1df-0af9ab5001b0] Received unexpected event network-vif-plugged-96f2c936-b17c-4576-88e3-bceabf0d612b for instance with vm_state deleted and task_state None.
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87ec4c01-e5a1-4860-bff8-fb6a23c09470 tempest-AttachSCSIVolumeTestJSON-453690146 tempest-AttachSCSIVolumeTestJSON-453690146-project-member] Lock "1a74de08-00b4-4fde-b1df-0af9ab5001b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.859s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:09 user nova-compute[75203]: INFO nova.compute.manager [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Terminating instance
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-7990fa16-b0d5-40b1-ac0e-3d15844fb86e req-0559d5db-88fd-4514-bb9b-ab30c010fc5d service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-vif-unplugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7990fa16-b0d5-40b1-ac0e-3d15844fb86e req-0559d5db-88fd-4514-bb9b-ab30c010fc5d service nova] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7990fa16-b0d5-40b1-ac0e-3d15844fb86e req-0559d5db-88fd-4514-bb9b-ab30c010fc5d service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7990fa16-b0d5-40b1-ac0e-3d15844fb86e req-0559d5db-88fd-4514-bb9b-ab30c010fc5d service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-7990fa16-b0d5-40b1-ac0e-3d15844fb86e req-0559d5db-88fd-4514-bb9b-ab30c010fc5d service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] No waiting events found dispatching network-vif-unplugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-7990fa16-b0d5-40b1-ac0e-3d15844fb86e req-0559d5db-88fd-4514-bb9b-ab30c010fc5d service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-vif-unplugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:42:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.policy [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1a7cdac05464b9ca3ef185aafe6ea0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b4d281e6da4779a68b17ecd896e6a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:42:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Creating image(s)
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Instance destroyed successfully.
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lazy-loading 'resources' on Instance uuid eec19476-5b8e-4d91-b0e3-6ecd0986632d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2141242460',display_name='tempest-TestServerVolumeAttachmentScenario-server-2141242460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2141242460',id=12,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXiig/ft+B2jr5SVTsnP+QQEXnzqbcBQPl55+4MzFT+j4CvH5nduKO2t460YjFPRzfUMgPZJYmuJmWWeWcJIkcFSlMadPe6TD7poay7gIAyQ6XFyXpzIiOzKhBEgG6Nug==',key_name='tempest-keypair-47000978',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3d89c2f27be453c810b8ea57efbc921',ramdisk_id='',reservation_id='r-mukwt9f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1676841860',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1676841860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7651a46356c14d6690c6422cc778187b',uuid=eec19476-5b8e-4d91-b0e3-6ecd0986632d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Converting VIF {"id": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "address": "fa:16:3e:91:98:94", "network": {"id": "2863569b-7646-4eaa-88d4-eede654c5597", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1562550852-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3d89c2f27be453c810b8ea57efbc921", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e627df-b7", "ovs_interfaceid": "80e627df-b79d-48cd-8445-3ca7c1cc7eeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:98:94,bridge_name='br-int',has_traffic_filtering=True,id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb,network=Network(2863569b-7646-4eaa-88d4-eede654c5597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e627df-b7') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG os_vif [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:98:94,bridge_name='br-int',has_traffic_filtering=True,id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb,network=Network(2863569b-7646-4eaa-88d4-eede654c5597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e627df-b7') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80e627df-b7, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12797914-c5c7-412e-8b3d-b2fefb88327d) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:10 user nova-compute[75203]: INFO os_vif [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:98:94,bridge_name='br-int',has_traffic_filtering=True,id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb,network=Network(2863569b-7646-4eaa-88d4-eede654c5597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e627df-b7')
Nov 28 18:42:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Deleting instance files /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d_del
Nov 28 18:42:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Deletion of /opt/stack/data/nova/instances/eec19476-5b8e-4d91-b0e3-6ecd0986632d_del complete
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.231s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:10 user nova-compute[75203]: INFO nova.compute.manager [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk 1073741824" returned: 0 in 0.054s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Cannot resize image /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Ensure instance console log exists: /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Successfully created port: cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-24eba3a7-f3dc-42aa-a3a1-34759e6f6995 req-779bde05-04be-4b39-9158-db862b61b975 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-vif-deleted-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:11 user nova-compute[75203]: INFO nova.compute.manager [req-24eba3a7-f3dc-42aa-a3a1-34759e6f6995 req-779bde05-04be-4b39-9158-db862b61b975 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Neutron deleted interface 80e627df-b79d-48cd-8445-3ca7c1cc7eeb; detaching it from the instance and deleting it from the info cache
Nov 28 18:42:11 user nova-compute[75203]: DEBUG nova.network.neutron [req-24eba3a7-f3dc-42aa-a3a1-34759e6f6995 req-779bde05-04be-4b39-9158-db862b61b975 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:11 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Took 1.30 seconds to deallocate network for instance.
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-a2de23db-624c-4e1a-8aab-620425c6ba6f req-202230c0-1cdb-4b5a-a924-0252f995be63 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received event network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a2de23db-624c-4e1a-8aab-620425c6ba6f req-202230c0-1cdb-4b5a-a924-0252f995be63 service nova] Acquiring lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a2de23db-624c-4e1a-8aab-620425c6ba6f req-202230c0-1cdb-4b5a-a924-0252f995be63 service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a2de23db-624c-4e1a-8aab-620425c6ba6f req-202230c0-1cdb-4b5a-a924-0252f995be63 service nova] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-a2de23db-624c-4e1a-8aab-620425c6ba6f req-202230c0-1cdb-4b5a-a924-0252f995be63 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] No waiting events found dispatching network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:12 user nova-compute[75203]: WARNING nova.compute.manager [req-a2de23db-624c-4e1a-8aab-620425c6ba6f req-202230c0-1cdb-4b5a-a924-0252f995be63 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Received unexpected event network-vif-plugged-80e627df-b79d-48cd-8445-3ca7c1cc7eeb for instance with vm_state active and task_state deleting.
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-24eba3a7-f3dc-42aa-a3a1-34759e6f6995 req-779bde05-04be-4b39-9158-db862b61b975 service nova] [instance: eec19476-5b8e-4d91-b0e3-6ecd0986632d] Detach interface failed, port_id=80e627df-b79d-48cd-8445-3ca7c1cc7eeb, reason: Instance eec19476-5b8e-4d91-b0e3-6ecd0986632d could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Successfully updated port: cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquired lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:12 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Deleted allocations for instance eec19476-5b8e-4d91-b0e3-6ecd0986632d
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d6c99c60-8292-41e4-8baa-e95a7db5ab6d tempest-TestServerVolumeAttachmentScenario-1676841860 tempest-TestServerVolumeAttachmentScenario-1676841860-project-member] Lock "eec19476-5b8e-4d91-b0e3-6ecd0986632d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.894s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Releasing lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance network_info: |[{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Start _get_guest_xml network_info=[{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:42:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:42:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391113207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391113207',id=21,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF9J3+Pzh3OKq4qmB7UoBTdy5lbcXGZFqgbDYOeKGR4db0mKBRX00rn92bjaSFSQz+YAMZjp1Gjlh5lgBDMBtwFUYzdHacd0OhSvQl1NzZpoh+RS0+yEauRaLtPpl1jLA==',key_name='tempest-keypair-743467751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-jmyn900h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=23ad8585-7fca-4c5b-b0d7-1258eb331c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'pci_devices' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:42:12 user nova-compute[75203]:   <uuid>23ad8585-7fca-4c5b-b0d7-1258eb331c39</uuid>
Nov 28 18:42:12 user nova-compute[75203]:   <name>instance-00000015</name>
Nov 28 18:42:12 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:42:12 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:42:12 user nova-compute[75203]:   <metadata>
Nov 28 18:42:12 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:42:12 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:42:12 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-391113207</nova:name>
Nov 28 18:42:12 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:42:12</nova:creationTime>
Nov 28 18:42:12 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:42:12 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:42:12 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:42:12 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:42:12 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:42:12 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:42:12 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:42:12 user nova-compute[75203]:       <nova:owner>
Nov 28 18:42:12 user nova-compute[75203]:         <nova:user uuid="c1a7cdac05464b9ca3ef185aafe6ea0d">tempest-AttachVolumeShelveTestJSON-1995055501-project-member</nova:user>
Nov 28 18:42:12 user nova-compute[75203]:         <nova:project uuid="39b4d281e6da4779a68b17ecd896e6a2">tempest-AttachVolumeShelveTestJSON-1995055501</nova:project>
Nov 28 18:42:12 user nova-compute[75203]:       </nova:owner>
Nov 28 18:42:12 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:42:12 user nova-compute[75203]:       <nova:ports>
Nov 28 18:42:12 user nova-compute[75203]:         <nova:port uuid="cc046f13-0661-4704-b2ba-6b22fc72c2b3">
Nov 28 18:42:12 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 18:42:12 user nova-compute[75203]:         </nova:port>
Nov 28 18:42:12 user nova-compute[75203]:       </nova:ports>
Nov 28 18:42:12 user nova-compute[75203]:     </nova:instance>
Nov 28 18:42:12 user nova-compute[75203]:   </metadata>
Nov 28 18:42:12 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:42:12 user nova-compute[75203]:     <system>
Nov 28 18:42:12 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:42:12 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:42:12 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:42:12 user nova-compute[75203]:       <entry name="serial">23ad8585-7fca-4c5b-b0d7-1258eb331c39</entry>
Nov 28 18:42:12 user nova-compute[75203]:       <entry name="uuid">23ad8585-7fca-4c5b-b0d7-1258eb331c39</entry>
Nov 28 18:42:12 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:42:12 user nova-compute[75203]:     </system>
Nov 28 18:42:12 user nova-compute[75203]:   </sysinfo>
Nov 28 18:42:12 user nova-compute[75203]:   <os>
Nov 28 18:42:12 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:42:12 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:42:12 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:42:12 user nova-compute[75203]:   </os>
Nov 28 18:42:12 user nova-compute[75203]:   <features>
Nov 28 18:42:12 user nova-compute[75203]:     <acpi/>
Nov 28 18:42:12 user nova-compute[75203]:     <apic/>
Nov 28 18:42:12 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:42:12 user nova-compute[75203]:   </features>
Nov 28 18:42:12 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:42:12 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:42:12 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:42:12 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:42:12 user nova-compute[75203]:   </clock>
Nov 28 18:42:12 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:42:12 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:42:12 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:42:12 user nova-compute[75203]:   </cpu>
Nov 28 18:42:12 user nova-compute[75203]:   <devices>
Nov 28 18:42:12 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:42:12 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:42:12 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk"/>
Nov 28 18:42:12 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:42:12 user nova-compute[75203]:     </disk>
Nov 28 18:42:12 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:42:12 user nova-compute[75203]:       <mac address="fa:16:3e:d5:2b:4b"/>
Nov 28 18:42:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:42:12 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:42:12 user nova-compute[75203]:       <target dev="tapcc046f13-06"/>
Nov 28 18:42:12 user nova-compute[75203]:     </interface>
Nov 28 18:42:12 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:42:12 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/console.log" append="off"/>
Nov 28 18:42:12 user nova-compute[75203]:     </serial>
Nov 28 18:42:12 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:42:12 user nova-compute[75203]:     <video>
Nov 28 18:42:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:42:12 user nova-compute[75203]:     </video>
Nov 28 18:42:12 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:42:12 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:42:12 user nova-compute[75203]:     </rng>
Nov 28 18:42:12 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:42:12 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:42:12 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:42:12 user nova-compute[75203]:     </memballoon>
Nov 28 18:42:12 user nova-compute[75203]:   </devices>
Nov 28 18:42:12 user nova-compute[75203]: </domain>
Nov 28 18:42:12 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391113207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391113207',id=21,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF9J3+Pzh3OKq4qmB7UoBTdy5lbcXGZFqgbDYOeKGR4db0mKBRX00rn92bjaSFSQz+YAMZjp1Gjlh5lgBDMBtwFUYzdHacd0OhSvQl1NzZpoh+RS0+yEauRaLtPpl1jLA==',key_name='tempest-keypair-743467751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-jmyn900h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=23ad8585-7fca-4c5b-b0d7-1258eb331c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG os_vif [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b8c8229-60ef-5f69-914c-733270f1538e', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc046f13-06, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc046f13-06, col_values=(('qos', UUID('865c376e-0059-44db-bd22-7bbfd7b687a7')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc046f13-06, col_values=(('external_ids', {'iface-id': 'cc046f13-0661-4704-b2ba-6b22fc72c2b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:2b:4b', 'vm-uuid': '23ad8585-7fca-4c5b-b0d7-1258eb331c39'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:12 user nova-compute[75203]: INFO os_vif [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06')
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No VIF found with MAC fa:16:3e:d5:2b:4b, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:42:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing instance network info cache due to event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] Acquiring lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] Acquired lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG nova.network.neutron [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:15 user nova-compute[75203]: DEBUG nova.network.neutron [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updated VIF entry in instance network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:42:15 user nova-compute[75203]: DEBUG nova.network.neutron [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3de770a6-3b83-4813-a5e1-ff464ac24bf8 req-99d60323-80f2-4c11-be4a-4421ed1a0fb9 service nova] Releasing lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:16 user nova-compute[75203]: WARNING nova.compute.manager [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received unexpected event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with vm_state building and task_state spawning.
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:42:16 user nova-compute[75203]: WARNING nova.compute.manager [req-d8e70b10-72d1-4c6d-b278-b5814e3659e3 req-9f1fda0c-afc0-4062-835c-9c3d11d4c012 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received unexpected event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with vm_state building and task_state spawning.
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:42:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance spawned successfully.
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:42:16 user nova-compute[75203]: INFO nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 28 18:42:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:42:16 user nova-compute[75203]: INFO nova.compute.manager [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Took 7.29 seconds to build instance.
Nov 28 18:42:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-77d768a5-edf7-491c-a110-fa2b1340e3b3 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.394s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:39 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-changed-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Refreshing instance network info cache due to event network-changed-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] Acquiring lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] Acquired lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Refreshing network info cache for port 3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updated VIF entry in instance network info cache for port 3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:42:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating instance_info_cache with network_info: [{"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c96f5d7e-6598-4922-b753-f59b5b81c26a req-b7bc89a1-43fe-4f9c-a8ac-4d0df7123fa3 service nova] Releasing lock "refresh_cache-621d6e6b-cf0b-45fd-850e-3145f5687ab3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:42:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:43 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:42:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG nova.objects.instance [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:45 user nova-compute[75203]: INFO nova.compute.manager [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attaching volume 32895027-bdb1-43e6-a7c3-dde464825576 to /dev/vdb
Nov 28 18:42:45 user nova-compute[75203]: DEBUG os_brick.utils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b9f3d0-976a-4309-a148-3fe49cb4920c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af970d30-3698-47f6-afef-904d1869b8a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b6ce14-e1be-49e4-a300-9488c87ebfd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1001a3-317a-4ad7-b535-c4e1dcce5da0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:42:45 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ab021-128d-45fe-bb30-dac4a7ca91d4]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG os_brick.utils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating existing volume attachment record: 307cd694-2d57-4b01-9a16-dfe77b0c975c {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:48 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:42:48 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=25.185195922851562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43538aa1-3ebe-4098-bd42-78353ed457ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 23ad8585-7fca-4c5b-b0d7-1258eb331c39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:42:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQOrWUah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:42:52 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:42:52 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:42:52 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b12ff81-52ef-4d54-a1fe-1ba8a557169e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:42:52 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[858bc186-281f-470b-b51e-9c3ff00c10c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576] added
Nov 28 18:42:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd31c106-b63b-45ad-80e6-e54569ee4d89]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb11cb28-d7ea-4717-96c9-7e226c73f324]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQOrWUah {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQOrWUah" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fc8048-669c-48d1-9a2c-efbe9653cfb9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oQOrWUah'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab65d224-df1a-4939-a8f6-b390d68f9051]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9ce8e6-2ed6-44bb-9b37-1dfb345f2141]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:42:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:42:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b36adb8-aa40-4eff-952d-7606e05a470c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260]
Nov 28 18:42:52 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260] successful.
Nov 28 18:42:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a702679d-bc81-4f03-8a55-f157bd076849]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed100a3d-1349-4340-8f6c-99607b3c51b8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:42:52 user nova-compute[75203]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 (non-flash)
Nov 28 18:42:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:42:52 user nova-compute[75203]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 (non-flash)
Nov 28 18:42:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:42:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4e5ba-0161-4955-8a65-ffd17c64f8f2]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQOrWUah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:42:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23966636632613633', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966636632613633', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG nova.objects.instance [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:42:54 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:42:54 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:42:54 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:42:54 user nova-compute[75203]:   <serial>32895027-bdb1-43e6-a7c3-dde464825576</serial>
Nov 28 18:42:54 user nova-compute[75203]: </disk>
Nov 28 18:42:54 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No VIF found with MAC fa:16:3e:cd:aa:27, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:42:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c9982239-070a-4b5c-91fc-876d77d8e85c tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.060s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:42:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:42:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:08 user nova-compute[75203]: INFO nova.compute.manager [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Detaching volume 32895027-bdb1-43e6-a7c3-dde464825576
Nov 28 18:43:08 user nova-compute[75203]: INFO nova.virt.block_device [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attempting to driver detach volume 32895027-bdb1-43e6-a7c3-dde464825576 from mountpoint /dev/vdb
Nov 28 18:43:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Attempting to detach device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:43:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:43:08 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:43:08 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:43:08 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:43:08 user nova-compute[75203]:   <serial>32895027-bdb1-43e6-a7c3-dde464825576</serial>
Nov 28 18:43:08 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:43:08 user nova-compute[75203]: </disk>
Nov 28 18:43:08 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:43:08 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config.
Nov 28 18:43:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:43:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:43:08 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:43:08 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:43:08 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:43:08 user nova-compute[75203]:   <serial>32895027-bdb1-43e6-a7c3-dde464825576</serial>
Nov 28 18:43:08 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:43:08 user nova-compute[75203]: </disk>
Nov 28 18:43:08 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:43:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:43:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:43:16 user nova-compute[75203]: INFO nova.compute.claims [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Claim successful on node user
Nov 28 18:43:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:43:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.policy [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f96761cb11ad45b0bbc9a0435d3c0324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d19b759f9948c9be9be5097069099b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:43:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Creating image(s)
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk 1073741824" returned: 0 in 0.056s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:17 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Successfully created port: 93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Cannot resize image /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Ensure instance console log exists: /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Successfully updated port: 93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing instance network info cache due to event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] Acquiring lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:43:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance network_info: |[{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] Acquired lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.neutron [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Start _get_guest_xml network_info=[{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:43:19 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:43:19 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1420770283',display_name='tempest-ServerRescueNegativeTestJSON-server-1420770283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1420770283',id=22,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYqxDm1iqu7KJ8Zdx8M2rPxexXzFXDX5EicJ2fN3cU5P6guw7wY8B61FlpPlU88Nr0OX0nonX4l48XyofV5e3ZkWSmjfyEbPd5+NmuWaMN89mpHnmgjwUH5ahQB+tqjLA==',key_name='tempest-keypair-1064251055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-7onh3nn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=13524911-1006-4646-9c67-def22fb36ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.objects.instance [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'pci_devices' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:43:19 user nova-compute[75203]:   <uuid>13524911-1006-4646-9c67-def22fb36ac4</uuid>
Nov 28 18:43:19 user nova-compute[75203]:   <name>instance-00000016</name>
Nov 28 18:43:19 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:43:19 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:43:19 user nova-compute[75203]:   <metadata>
Nov 28 18:43:19 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:43:19 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:43:19 user nova-compute[75203]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1420770283</nova:name>
Nov 28 18:43:19 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:43:19</nova:creationTime>
Nov 28 18:43:19 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:43:19 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:43:19 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:43:19 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:43:19 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:43:19 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:43:19 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:43:19 user nova-compute[75203]:       <nova:owner>
Nov 28 18:43:19 user nova-compute[75203]:         <nova:user uuid="f96761cb11ad45b0bbc9a0435d3c0324">tempest-ServerRescueNegativeTestJSON-2096861107-project-member</nova:user>
Nov 28 18:43:19 user nova-compute[75203]:         <nova:project uuid="13d19b759f9948c9be9be5097069099b">tempest-ServerRescueNegativeTestJSON-2096861107</nova:project>
Nov 28 18:43:19 user nova-compute[75203]:       </nova:owner>
Nov 28 18:43:19 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:43:19 user nova-compute[75203]:       <nova:ports>
Nov 28 18:43:19 user nova-compute[75203]:         <nova:port uuid="93f2167d-e2f4-49cc-9a16-f423db7c60a9">
Nov 28 18:43:19 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 18:43:19 user nova-compute[75203]:         </nova:port>
Nov 28 18:43:19 user nova-compute[75203]:       </nova:ports>
Nov 28 18:43:19 user nova-compute[75203]:     </nova:instance>
Nov 28 18:43:19 user nova-compute[75203]:   </metadata>
Nov 28 18:43:19 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:43:19 user nova-compute[75203]:     <system>
Nov 28 18:43:19 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:43:19 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:43:19 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:43:19 user nova-compute[75203]:       <entry name="serial">13524911-1006-4646-9c67-def22fb36ac4</entry>
Nov 28 18:43:19 user nova-compute[75203]:       <entry name="uuid">13524911-1006-4646-9c67-def22fb36ac4</entry>
Nov 28 18:43:19 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:43:19 user nova-compute[75203]:     </system>
Nov 28 18:43:19 user nova-compute[75203]:   </sysinfo>
Nov 28 18:43:19 user nova-compute[75203]:   <os>
Nov 28 18:43:19 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:43:19 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:43:19 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:43:19 user nova-compute[75203]:   </os>
Nov 28 18:43:19 user nova-compute[75203]:   <features>
Nov 28 18:43:19 user nova-compute[75203]:     <acpi/>
Nov 28 18:43:19 user nova-compute[75203]:     <apic/>
Nov 28 18:43:19 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:43:19 user nova-compute[75203]:   </features>
Nov 28 18:43:19 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:43:19 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:43:19 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:43:19 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:43:19 user nova-compute[75203]:   </clock>
Nov 28 18:43:19 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:43:19 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:43:19 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:43:19 user nova-compute[75203]:   </cpu>
Nov 28 18:43:19 user nova-compute[75203]:   <devices>
Nov 28 18:43:19 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:43:19 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:43:19 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk"/>
Nov 28 18:43:19 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:43:19 user nova-compute[75203]:     </disk>
Nov 28 18:43:19 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:43:19 user nova-compute[75203]:       <mac address="fa:16:3e:4b:cc:1a"/>
Nov 28 18:43:19 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:43:19 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:43:19 user nova-compute[75203]:       <target dev="tap93f2167d-e2"/>
Nov 28 18:43:19 user nova-compute[75203]:     </interface>
Nov 28 18:43:19 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:43:19 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/console.log" append="off"/>
Nov 28 18:43:19 user nova-compute[75203]:     </serial>
Nov 28 18:43:19 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:43:19 user nova-compute[75203]:     <video>
Nov 28 18:43:19 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:43:19 user nova-compute[75203]:     </video>
Nov 28 18:43:19 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:43:19 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:43:19 user nova-compute[75203]:     </rng>
Nov 28 18:43:19 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:43:19 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:43:19 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:43:19 user nova-compute[75203]:     </memballoon>
Nov 28 18:43:19 user nova-compute[75203]:   </devices>
Nov 28 18:43:19 user nova-compute[75203]: </domain>
Nov 28 18:43:19 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1420770283',display_name='tempest-ServerRescueNegativeTestJSON-server-1420770283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1420770283',id=22,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYqxDm1iqu7KJ8Zdx8M2rPxexXzFXDX5EicJ2fN3cU5P6guw7wY8B61FlpPlU88Nr0OX0nonX4l48XyofV5e3ZkWSmjfyEbPd5+NmuWaMN89mpHnmgjwUH5ahQB+tqjLA==',key_name='tempest-keypair-1064251055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-7onh3nn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=13524911-1006-4646-9c67-def22fb36ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG os_vif [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6c341e-0f84-59b3-b59c-cb25b2578fd5', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93f2167d-e2, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93f2167d-e2, col_values=(('qos', UUID('9e2fc3cb-9442-4089-bc5f-8f36f9c7225a')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93f2167d-e2, col_values=(('external_ids', {'iface-id': '93f2167d-e2f4-49cc-9a16-f423db7c60a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:cc:1a', 'vm-uuid': '13524911-1006-4646-9c67-def22fb36ac4'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:19 user nova-compute[75203]: INFO os_vif [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2')
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No VIF found with MAC fa:16:3e:4b:cc:1a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.neutron [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updated VIF entry in instance network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG nova.network.neutron [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:43:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e73ed41a-e4a3-4ca9-a982-e6957ca3577d req-89da5120-a59f-4bd4-b8d2-2130e7042601 service nova] Releasing lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:43:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-db34810c-38b2-438c-a458-79e1c693cfde req-03d5e589-f319-4d5d-b727-1c17fd51e87b service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-db34810c-38b2-438c-a458-79e1c693cfde req-03d5e589-f319-4d5d-b727-1c17fd51e87b service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-db34810c-38b2-438c-a458-79e1c693cfde req-03d5e589-f319-4d5d-b727-1c17fd51e87b service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-db34810c-38b2-438c-a458-79e1c693cfde req-03d5e589-f319-4d5d-b727-1c17fd51e87b service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-db34810c-38b2-438c-a458-79e1c693cfde req-03d5e589-f319-4d5d-b727-1c17fd51e87b service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:43:21 user nova-compute[75203]: WARNING nova.compute.manager [req-db34810c-38b2-438c-a458-79e1c693cfde req-03d5e589-f319-4d5d-b727-1c17fd51e87b service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state building and task_state spawning.
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:43:22 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance spawned successfully.
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:22 user nova-compute[75203]: INFO nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 28 18:43:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:43:22 user nova-compute[75203]: INFO nova.compute.manager [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Took 6.39 seconds to build instance.
Nov 28 18:43:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-47383b93-473d-4313-9594-820cb0422f04 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.518s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-2e5d491a-009f-421c-9314-3a52965ba495 req-0cedf6e7-e2ff-41c3-8ada-ecf8d873c8b1 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2e5d491a-009f-421c-9314-3a52965ba495 req-0cedf6e7-e2ff-41c3-8ada-ecf8d873c8b1 service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2e5d491a-009f-421c-9314-3a52965ba495 req-0cedf6e7-e2ff-41c3-8ada-ecf8d873c8b1 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2e5d491a-009f-421c-9314-3a52965ba495 req-0cedf6e7-e2ff-41c3-8ada-ecf8d873c8b1 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-2e5d491a-009f-421c-9314-3a52965ba495 req-0cedf6e7-e2ff-41c3-8ada-ecf8d873c8b1 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:43:24 user nova-compute[75203]: WARNING nova.compute.manager [req-2e5d491a-009f-421c-9314-3a52965ba495 req-0cedf6e7-e2ff-41c3-8ada-ecf8d873c8b1 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state active and task_state None.
Nov 28 18:43:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 is timed out.
Nov 28 18:43:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config.
Nov 28 18:43:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQOrWUah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:43:28 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62e8dc-d7cf-4c5b-850a-a9aa980d117f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:43:28 user nova-compute[75203]: No targets found.
Nov 28 18:43:28 user nova-compute[75203]: iSNS:
Nov 28 18:43:28 user nova-compute[75203]: No targets found.
Nov 28 18:43:28 user nova-compute[75203]: STATIC:
Nov 28 18:43:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576
Nov 28 18:43:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:43:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:43:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738
Nov 28 18:43:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:43:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:43:28 user nova-compute[75203]: FIRMWARE:
Nov 28 18:43:28 user nova-compute[75203]: No targets found.
Nov 28 18:43:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:43:28 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:43:28 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba22ad-415d-41f5-acc6-04a88ccbf993]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2063edb1-84b7-472d-be50-20d5d7991727]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:28 user nova-compute[75203]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 (non-flash)
Nov 28 18:43:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:28 user nova-compute[75203]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 (non-flash)
Nov 28 18:43:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07902a0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3e5758-ff3a-444c-a832-8589845897ec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16001a8-caa5-4e18-b6f8-aff89f18362c]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[71096098-025b-48ff-8524-bbba26cc4ab7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[57917ed1-3a80-4a0b-905f-8e381c8b38f4]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:43:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6f701-13ca-4e71-b4ab-e93f44e54371]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f00450-5e6f-49d4-9f09-2c5a9be68cf7]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260]
Nov 28 18:43:29 user nova-compute[75203]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576, portal: 172.16.0.220,3260] successful.
Nov 28 18:43:29 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32895027-bdb1-43e6-a7c3-dde464825576 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0647de8a-11be-4e33-bdcc-72f70e2a4103]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== disconnect_volume: return (310ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG nova.objects.instance [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:43:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-28521659-cf3c-44f7-bbb9-32b68694fd65 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.713s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:30 user nova-compute[75203]: INFO nova.compute.manager [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Detaching volume 8bf8ef1a-68e8-4348-95fd-16b892e29738
Nov 28 18:43:30 user nova-compute[75203]: INFO nova.virt.block_device [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Attempting to driver detach volume 8bf8ef1a-68e8-4348-95fd-16b892e29738 from mountpoint /dev/vdb
Nov 28 18:43:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Attempting to detach device vdb from instance 43538aa1-3ebe-4098-bd42-78353ed457ce from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:43:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:43:30 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:43:30 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:43:30 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:43:30 user nova-compute[75203]:   <serial>8bf8ef1a-68e8-4348-95fd-16b892e29738</serial>
Nov 28 18:43:30 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 18:43:30 user nova-compute[75203]: </disk>
Nov 28 18:43:30 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:43:30 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully detached device vdb from instance 43538aa1-3ebe-4098-bd42-78353ed457ce from the persistent domain config.
Nov 28 18:43:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43538aa1-3ebe-4098-bd42-78353ed457ce from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:43:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:43:30 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:43:30 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:43:30 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:43:30 user nova-compute[75203]:   <serial>8bf8ef1a-68e8-4348-95fd-16b892e29738</serial>
Nov 28 18:43:30 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 18:43:30 user nova-compute[75203]: </disk>
Nov 28 18:43:30 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:43:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:43:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:43:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:43:31 user nova-compute[75203]: INFO nova.compute.claims [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Claim successful on node user
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.network.neutron [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:43:32 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.policy [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ca19ed1c66845259ec4a7aac7b9d611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c1fcb569344efe86c3ef2744817065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:43:32 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Creating image(s)
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.237s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk 1073741824" returned: 0 in 0.053s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.229s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Successfully created port: aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Cannot resize image /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Ensure instance console log exists: /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Successfully updated port: aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquired lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-changed-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Refreshing instance network info cache due to event network-changed-aa825c53-e639-46d8-8e5c-91f08c239f9e. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] Acquiring lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:43:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Releasing lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Instance network_info: |[{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] Acquired lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Refreshing network info cache for port aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Start _get_guest_xml network_info=[{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:43:34 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:43:34 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converting VIF {"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:2b:8d,bridge_name='br-int',has_traffic_filtering=True,id=aa825c53-e639-46d8-8e5c-91f08c239f9e,network=Network(caf18f37-242a-4180-8d6d-ac4999e4daf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa825c53-e6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.objects.instance [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'pci_devices' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:43:34 user nova-compute[75203]:   <uuid>177bbb95-7d1b-4c19-b3fd-182653317455</uuid>
Nov 28 18:43:34 user nova-compute[75203]:   <name>instance-00000017</name>
Nov 28 18:43:34 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:43:34 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:43:34 user nova-compute[75203]:   <metadata>
Nov 28 18:43:34 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:43:34 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:43:34 user nova-compute[75203]:       <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:43:34 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:43:34</nova:creationTime>
Nov 28 18:43:34 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:43:34 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:43:34 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:43:34 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:43:34 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:43:34 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:43:34 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:43:34 user nova-compute[75203]:       <nova:owner>
Nov 28 18:43:34 user nova-compute[75203]:         <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:43:34 user nova-compute[75203]:         <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:43:34 user nova-compute[75203]:       </nova:owner>
Nov 28 18:43:34 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:43:34 user nova-compute[75203]:       <nova:ports>
Nov 28 18:43:34 user nova-compute[75203]:         <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:43:34 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:43:34 user nova-compute[75203]:         </nova:port>
Nov 28 18:43:34 user nova-compute[75203]:       </nova:ports>
Nov 28 18:43:34 user nova-compute[75203]:     </nova:instance>
Nov 28 18:43:34 user nova-compute[75203]:   </metadata>
Nov 28 18:43:34 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:43:34 user nova-compute[75203]:     <system>
Nov 28 18:43:34 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:43:34 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:43:34 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:43:34 user nova-compute[75203]:       <entry name="serial">177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:43:34 user nova-compute[75203]:       <entry name="uuid">177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:43:34 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:43:34 user nova-compute[75203]:     </system>
Nov 28 18:43:34 user nova-compute[75203]:   </sysinfo>
Nov 28 18:43:34 user nova-compute[75203]:   <os>
Nov 28 18:43:34 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:43:34 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:43:34 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:43:34 user nova-compute[75203]:   </os>
Nov 28 18:43:34 user nova-compute[75203]:   <features>
Nov 28 18:43:34 user nova-compute[75203]:     <acpi/>
Nov 28 18:43:34 user nova-compute[75203]:     <apic/>
Nov 28 18:43:34 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:43:34 user nova-compute[75203]:   </features>
Nov 28 18:43:34 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:43:34 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:43:34 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:43:34 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:43:34 user nova-compute[75203]:   </clock>
Nov 28 18:43:34 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:43:34 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:43:34 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:43:34 user nova-compute[75203]:   </cpu>
Nov 28 18:43:34 user nova-compute[75203]:   <devices>
Nov 28 18:43:34 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:43:34 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:43:34 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk"/>
Nov 28 18:43:34 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:43:34 user nova-compute[75203]:     </disk>
Nov 28 18:43:34 user nova-compute[75203]:     <disk type="file" device="cdrom">
Nov 28 18:43:34 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none"/>
Nov 28 18:43:34 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config"/>
Nov 28 18:43:34 user nova-compute[75203]:       <target dev="hda" bus="ide"/>
Nov 28 18:43:34 user nova-compute[75203]:     </disk>
Nov 28 18:43:34 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:43:34 user nova-compute[75203]:       <mac address="fa:16:3e:19:2b:8d"/>
Nov 28 18:43:34 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:43:34 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:43:34 user nova-compute[75203]:       <target dev="tapaa825c53-e6"/>
Nov 28 18:43:34 user nova-compute[75203]:     </interface>
Nov 28 18:43:34 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:43:34 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log" append="off"/>
Nov 28 18:43:34 user nova-compute[75203]:     </serial>
Nov 28 18:43:34 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:43:34 user nova-compute[75203]:     <video>
Nov 28 18:43:34 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:43:34 user nova-compute[75203]:     </video>
Nov 28 18:43:34 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:43:34 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:43:34 user nova-compute[75203]:     </rng>
Nov 28 18:43:34 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:43:34 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:43:34 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:43:34 user nova-compute[75203]:     </memballoon>
Nov 28 18:43:34 user nova-compute[75203]:   </devices>
Nov 28 18:43:34 user nova-compute[75203]: </domain>
Nov 28 18:43:34 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converting VIF {"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:2b:8d,bridge_name='br-int',has_traffic_filtering=True,id=aa825c53-e639-46d8-8e5c-91f08c239f9e,network=Network(caf18f37-242a-4180-8d6d-ac4999e4daf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa825c53-e6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG os_vif [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:2b:8d,bridge_name='br-int',has_traffic_filtering=True,id=aa825c53-e639-46d8-8e5c-91f08c239f9e,network=Network(caf18f37-242a-4180-8d6d-ac4999e4daf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa825c53-e6') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ece366be-f7bc-5099-b53a-285a3f440bed', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa825c53-e6, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa825c53-e6, col_values=(('qos', UUID('fc9be8f6-279a-489e-80e6-ebe839996649')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa825c53-e6, col_values=(('external_ids', {'iface-id': 'aa825c53-e639-46d8-8e5c-91f08c239f9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:2b:8d', 'vm-uuid': '177bbb95-7d1b-4c19-b3fd-182653317455'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:34 user nova-compute[75203]: INFO os_vif [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:2b:8d,bridge_name='br-int',has_traffic_filtering=True,id=aa825c53-e639-46d8-8e5c-91f08c239f9e,network=Network(caf18f37-242a-4180-8d6d-ac4999e4daf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa825c53-e6')
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No BDM found with device name hda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:43:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No VIF found with MAC fa:16:3e:19:2b:8d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:43:34 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Using config drive
Nov 28 18:43:34 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Creating config drive at /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config
Nov 28 18:43:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpthdte4ak {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpthdte4ak" returned: 0 in 0.054s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updated VIF entry in instance network info cache for port aa825c53-e639-46d8-8e5c-91f08c239f9e. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:43:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:43:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e64b5c86-9082-4f01-aead-ccd82fdf06e0 req-724e4c3a-646c-40ee-b781-da28c697e104 service nova] Releasing lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-a68d6405-4f06-40b2-84f4-111b34601d9e req-8065665d-f4c3-4c6d-8599-23b2c0ddb747 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a68d6405-4f06-40b2-84f4-111b34601d9e req-8065665d-f4c3-4c6d-8599-23b2c0ddb747 service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a68d6405-4f06-40b2-84f4-111b34601d9e req-8065665d-f4c3-4c6d-8599-23b2c0ddb747 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a68d6405-4f06-40b2-84f4-111b34601d9e req-8065665d-f4c3-4c6d-8599-23b2c0ddb747 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-a68d6405-4f06-40b2-84f4-111b34601d9e req-8065665d-f4c3-4c6d-8599-23b2c0ddb747 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:43:36 user nova-compute[75203]: WARNING nova.compute.manager [req-a68d6405-4f06-40b2-84f4-111b34601d9e req-8065665d-f4c3-4c6d-8599-23b2c0ddb747 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received unexpected event network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e for instance with vm_state building and task_state spawning.
Nov 28 18:43:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:43:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Instance spawned successfully.
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:43:38 user nova-compute[75203]: INFO nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-3d66b3ac-2410-40ab-a606-6d33fde5cb73 req-984b395d-de2a-432b-8016-05dd859b7e74 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3d66b3ac-2410-40ab-a606-6d33fde5cb73 req-984b395d-de2a-432b-8016-05dd859b7e74 service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3d66b3ac-2410-40ab-a606-6d33fde5cb73 req-984b395d-de2a-432b-8016-05dd859b7e74 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3d66b3ac-2410-40ab-a606-6d33fde5cb73 req-984b395d-de2a-432b-8016-05dd859b7e74 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-3d66b3ac-2410-40ab-a606-6d33fde5cb73 req-984b395d-de2a-432b-8016-05dd859b7e74 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:43:38 user nova-compute[75203]: WARNING nova.compute.manager [req-3d66b3ac-2410-40ab-a606-6d33fde5cb73 req-984b395d-de2a-432b-8016-05dd859b7e74 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received unexpected event network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e for instance with vm_state building and task_state spawning.
Nov 28 18:43:38 user nova-compute[75203]: INFO nova.compute.manager [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Took 7.17 seconds to build instance.
Nov 28 18:43:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-54dd53fe-0279-48aa-810f-367a95498c4c tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.268s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:43:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lazy-loading 'flavor' on Instance uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:43 user nova-compute[75203]: INFO nova.compute.manager [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Attaching volume 8edef2a2-3c2d-4a41-993e-f47d082e848b to /dev/vdb
Nov 28 18:43:43 user nova-compute[75203]: DEBUG os_brick.utils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0aa026-720d-447a-8edc-679cef8ce4ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea9a86-e259-42d5-9db3-901a4fbade8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f45343-ce24-4f53-bdbb-fe889d894a92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6187e41-68f0-4b1b-896f-4bd590374ce2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:43:44 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3acf0df-6eca-4159-b644-f7668a3cc003]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG os_brick.utils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating existing volume attachment record: 473fc825-4cf0-431e-9202-1b325e59a6c3 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:43:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:43:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.181381225585938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:43:49 user nova-compute[75203]: INFO nova.compute.manager [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] instance snapshotting
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43538aa1-3ebe-4098-bd42-78353ed457ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 23ad8585-7fca-4c5b-b0d7-1258eb331c39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 13524911-1006-4646-9c67-def22fb36ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 177bbb95-7d1b-4c19-b3fd-182653317455 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:43:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:43:50 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Beginning live snapshot process
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_49jg43t/055fd9fa87a64f95b5c255fadf493976.delta 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_49jg43t/055fd9fa87a64f95b5c255fadf493976.delta 1073741824" returned: 0 in 0.047s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:50 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 18:43:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:43:50 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:43:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:43:50 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:43:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:43:50 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fae417-0e8d-4048-b8d4-61628da09811]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:43:50 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0928d09d-4150-4a0c-946c-5677a19fc745]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b] added
Nov 28 18:43:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77f14d-37fd-4831-8efd-3b7f2a7b92d6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c33d26b-b13f-4767-84b4-0428c78f4855]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVYPrlp {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVYPrlp" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[88355c36-40ff-4c6d-8044-46ed3d6c04d8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HWVYPrlp'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc94e7-62d2-4666-897c-c66362b38795]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4289a37b-83a1-46d3-91ef-8de2b3a421ed]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43538aa1-3ebe-4098-bd42-78353ed457ce is timed out.
Nov 28 18:43:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully detached device vdb from instance 43538aa1-3ebe-4098-bd42-78353ed457ce from the live domain config.
Nov 28 18:43:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTEjbspr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:43:51 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a809e46-8202-40b8-a8e9-6d4ea5b27a97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]
Nov 28 18:43:51 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.
Nov 28 18:43:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[13893499-a850-45e9-a8c6-f1c4d4dd2708]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f0a78d-9f9e-443f-9028-5b4828e5b6d8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:51 user nova-compute[75203]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:43:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:51 user nova-compute[75203]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:43:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d59bf5-97fa-442f-b8c4-ab605ba7b845]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:43:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:43:52 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_49jg43t/055fd9fa87a64f95b5c255fadf493976.delta /opt/stack/data/nova/instances/snapshots/tmp_49jg43t/055fd9fa87a64f95b5c255fadf493976 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23366353862323563', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366353862323563', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.116s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lazy-loading 'flavor' on Instance uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1596393e-947a-4ad3-9b88-2e93d031fea1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:43:52 user nova-compute[75203]: No targets found.
Nov 28 18:43:52 user nova-compute[75203]: iSNS:
Nov 28 18:43:52 user nova-compute[75203]: No targets found.
Nov 28 18:43:52 user nova-compute[75203]: STATIC:
Nov 28 18:43:52 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:43:52 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:43:52 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:43:52 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738
Nov 28 18:43:52 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:43:52 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:43:52 user nova-compute[75203]: FIRMWARE:
Nov 28 18:43:52 user nova-compute[75203]: No targets found.
Nov 28 18:43:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:43:52 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:43:52 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e670fa5-4a89-41ab-9f35-fa0b988a485c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa133fb-52cb-48c8-822e-892c767aa864]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:52 user nova-compute[75203]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:43:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 (non-flash)
Nov 28 18:43:52 user nova-compute[75203]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:43:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a81f0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:43:52 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:43:52 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:43:52 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:43:52 user nova-compute[75203]:   <serial>8edef2a2-3c2d-4a41-993e-f47d082e848b</serial>
Nov 28 18:43:52 user nova-compute[75203]: </disk>
Nov 28 18:43:52 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3739c7f1-bed6-4a12-b66c-d64f1c7ac519]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbfe6ae-2a17-4f16-8a0b-cc440b0c4e4a]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d01d0a-1194-49ce-8e5a-1fa9014d74c3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[00de1083-209c-46fd-8720-8553e36bc0e8]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_49jg43t/055fd9fa87a64f95b5c255fadf493976.delta /opt/stack/data/nova/instances/snapshots/tmp_49jg43t/055fd9fa87a64f95b5c255fadf493976" returned: 0 in 0.511s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Snapshot extracted, beginning image upload
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf842b8-b0c4-469d-9be8-b9730f693ef6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b58837-0df3-4e35-82a2-559ca68d037b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260]
Nov 28 18:43:52 user nova-compute[75203]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738, portal: 172.16.0.220,3260] successful.
Nov 28 18:43:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf8ef1a-68e8-4348-95fd-16b892e29738 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[836830b3-fba6-4fee-9d78-92de95d7f2bf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== disconnect_volume: return (1578ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No VIF found with MAC fa:16:3e:7e:8f:c7, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:43:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-00a45fdf-28d6-47e5-b243-09d364e19e75 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.106s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:53 user nova-compute[75203]: DEBUG nova.objects.instance [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'flavor' on Instance uuid 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:43:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-90e1a6ce-aa81-4d4d-9723-9cbb6964d2d2 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.048s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:54 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:43:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:43:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:43:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:43:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:43:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updating instance_info_cache with network_info: [{"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:43:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-017ccf79-0df6-4fb7-a551-0b67f8e6afe3" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:43:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:43:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Snapshot image upload complete
Nov 28 18:43:55 user nova-compute[75203]: INFO nova.compute.manager [None req-0a2b97b9-ef17-4ada-982f-a6c41c832d26 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Took 5.32 seconds to snapshot the instance on the hypervisor.
Nov 28 18:43:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Stashing vm_state: active {{(pid=75203) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 18:43:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:55 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:43:55 user nova-compute[75203]: INFO nova.compute.claims [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Claim successful on node user
Nov 28 18:43:55 user nova-compute[75203]: INFO nova.compute.resource_tracker [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating resource usage from migration f8087fee-6858-4bd7-b1be-4bf58e6a4557
Nov 28 18:43:56 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.526s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:56 user nova-compute[75203]: INFO nova.compute.manager [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Migrating
Nov 28 18:43:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:43:56 user nova-compute[75203]: INFO nova.compute.rpcapi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 28 18:43:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG nova.network.neutron [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG nova.network.neutron [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Starting migrate_disk_and_power_off {{(pid=75203) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-4fb5bf78-ee20-4f47-8542-e17b58e7116c req-580cdbf5-f669-41ae-b3c3-21140c4047df service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fb5bf78-ee20-4f47-8542-e17b58e7116c req-580cdbf5-f669-41ae-b3c3-21140c4047df service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fb5bf78-ee20-4f47-8542-e17b58e7116c req-580cdbf5-f669-41ae-b3c3-21140c4047df service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fb5bf78-ee20-4f47-8542-e17b58e7116c req-580cdbf5-f669-41ae-b3c3-21140c4047df service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-4fb5bf78-ee20-4f47-8542-e17b58e7116c req-580cdbf5-f669-41ae-b3c3-21140c4047df service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:43:57 user nova-compute[75203]: WARNING nova.compute.manager [req-4fb5bf78-ee20-4f47-8542-e17b58e7116c req-580cdbf5-f669-41ae-b3c3-21140c4047df service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state resize_migrating.
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance destroyed successfully.
Nov 28 18:43:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-97127879-network", "vif_mac": "fa:16:3e:7e:8f:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-97127879-network", "vif_mac": "fa:16:3e:7e:8f:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_vif [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51986925-f2, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9662ec5-31ea-44c4-b2bc-8d0086526c75) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:57 user nova-compute[75203]: INFO os_vif [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2')
Nov 28 18:43:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:43:57 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b025bd-c1d5-4391-b840-c7b5158cf4d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:43:57 user nova-compute[75203]: No targets found.
Nov 28 18:43:57 user nova-compute[75203]: iSNS:
Nov 28 18:43:57 user nova-compute[75203]: No targets found.
Nov 28 18:43:57 user nova-compute[75203]: STATIC:
Nov 28 18:43:57 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:43:57 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:43:57 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:43:57 user nova-compute[75203]: FIRMWARE:
Nov 28 18:43:57 user nova-compute[75203]: No targets found.
Nov 28 18:43:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:43:57 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:43:57 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1589eb80-2914-4e6a-9964-19d93d9629b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb9c7e8-71af-49b6-ab00-f9877af1ea5b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:43:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:43:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a03bbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20be51-9a62-41c5-babb-8bd88e5bd72f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e4cedc-4cd0-496c-a736-967750469ab1]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef4d771-5f6b-4a19-ae07-b42baff57247]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb997e4-181c-4775-81c7-6a17d3670c46]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f9404-dc2b-4cfa-800f-1a97e40548bb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75effb5-1282-4d64-8b62-116b75a19da4]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]
Nov 28 18:43:57 user nova-compute[75203]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.
Nov 28 18:43:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf72c40-df3a-4dc0-9f6a-bc1cdf1f0049]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== disconnect_volume: return (277ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:43:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492_resize/disk /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "cp -r /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492_resize/disk /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk" returned: 0 in 0.362s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492_resize/disk.info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk.info {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:43:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "cp -r /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492_resize/disk.info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk.info" returned: 0 in 0.036s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:43:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-bb7e7401-05fa-48e7-8f4c-06166d542d0a req-a170ba75-2223-4c86-9273-18477049494f service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:43:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bb7e7401-05fa-48e7-8f4c-06166d542d0a req-a170ba75-2223-4c86-9273-18477049494f service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:43:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bb7e7401-05fa-48e7-8f4c-06166d542d0a req-a170ba75-2223-4c86-9273-18477049494f service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:43:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bb7e7401-05fa-48e7-8f4c-06166d542d0a req-a170ba75-2223-4c86-9273-18477049494f service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:43:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-bb7e7401-05fa-48e7-8f4c-06166d542d0a req-a170ba75-2223-4c86-9273-18477049494f service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:43:59 user nova-compute[75203]: WARNING nova.compute.manager [req-bb7e7401-05fa-48e7-8f4c-06166d542d0a req-a170ba75-2223-4c86-9273-18477049494f service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state resize_migrating.
Nov 28 18:43:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Port 51986925-f22e-4528-b519-836232111180 binding to destination host user is already ACTIVE {{(pid=75203) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG os_brick.utils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a710dfe1-244b-4808-9e90-85f53a09ac24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2417a5-f6a7-4622-b26b-a58272d8e9da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[197fbe13-ef69-40e2-8e8c-26c08195d320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e1e4c-6410-4b8f-b70c-8c51236d85c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:44:00 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:44:00 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a00a0fa-0810-47ac-a876-4a2d3203a8bf]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:44:00 user nova-compute[75203]: DEBUG os_brick.utils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing instance network info cache due to event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] Acquiring lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] Acquired lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updated VIF entry in instance network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1b410bbf-0ff9-4857-b089-b8ace2ed6663 req-54d957d9-c258-4f8e-9f22-cf9d1a98ced7 service nova] Releasing lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:01 user nova-compute[75203]: INFO nova.compute.manager [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attaching volume 5e0ef794-69ae-478c-9f32-b32711acdbe8 to /dev/vdb
Nov 28 18:44:01 user nova-compute[75203]: DEBUG os_brick.utils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3162ed-f411-4674-91e9-46064a82b95b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[255fc3f8-1f79-4585-b61a-186788074077]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7ca170-9923-457f-85ac-8aab6c79951c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c2e40f-a957-404b-af26-a3816ff17b29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:44:02 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:44:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a8c01-546e-4527-8687-014ee2c4dcce]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG os_brick.utils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating existing volume attachment record: dc24f9b2-4f18-4a61-985a-39c0fce39879 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:44:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:04 user nova-compute[75203]: INFO nova.compute.manager [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Shelving
Nov 28 18:44:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-76158862-231f-4fb3-b7ab-3661f880538f req-93ae77c4-fd17-4bda-b3ba-ab5bb83807fe service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-unplugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-76158862-231f-4fb3-b7ab-3661f880538f req-93ae77c4-fd17-4bda-b3ba-ab5bb83807fe service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-76158862-231f-4fb3-b7ab-3661f880538f req-93ae77c4-fd17-4bda-b3ba-ab5bb83807fe service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-76158862-231f-4fb3-b7ab-3661f880538f req-93ae77c4-fd17-4bda-b3ba-ab5bb83807fe service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-76158862-231f-4fb3-b7ab-3661f880538f req-93ae77c4-fd17-4bda-b3ba-ab5bb83807fe service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-unplugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:44:04 user nova-compute[75203]: WARNING nova.compute.manager [req-76158862-231f-4fb3-b7ab-3661f880538f req-93ae77c4-fd17-4bda-b3ba-ab5bb83807fe service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received unexpected event network-vif-unplugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with vm_state active and task_state shelving.
Nov 28 18:44:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance destroyed successfully.
Nov 28 18:44:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Beginning cold snapshot process
Nov 28 18:44:04 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:44:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk /opt/stack/data/nova/instances/snapshots/tmpbzp124hm/c06437eb007b4f0992b8686036d43591 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk /opt/stack/data/nova/instances/snapshots/tmpbzp124hm/c06437eb007b4f0992b8686036d43591" returned: 0 in 0.835s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Snapshot extracted, beginning image upload
Nov 28 18:44:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-bac8d47e-a37e-4952-9d81-d0cca90586bc req-e00be187-cd3b-413d-983d-4cc845aa7731 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bac8d47e-a37e-4952-9d81-d0cca90586bc req-e00be187-cd3b-413d-983d-4cc845aa7731 service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bac8d47e-a37e-4952-9d81-d0cca90586bc req-e00be187-cd3b-413d-983d-4cc845aa7731 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bac8d47e-a37e-4952-9d81-d0cca90586bc req-e00be187-cd3b-413d-983d-4cc845aa7731 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-bac8d47e-a37e-4952-9d81-d0cca90586bc req-e00be187-cd3b-413d-983d-4cc845aa7731 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:44:06 user nova-compute[75203]: WARNING nova.compute.manager [req-bac8d47e-a37e-4952-9d81-d0cca90586bc req-e00be187-cd3b-413d-983d-4cc845aa7731 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received unexpected event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with vm_state active and task_state shelving_image_uploading.
Nov 28 18:44:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Starting finish_migration {{(pid=75203) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 18:44:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:44:07 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Creating image(s)
Nov 28 18:44:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk. size=21474836480 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Snapshot image upload complete
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk 21474836480 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk 21474836480" returned: 0 in 0.056s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Ensure instance console log exists: /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Start _get_guest_xml network_info=[{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-97127879-network", "vif_mac": "fa:16:3e:7e:8f:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '449f7a33-7a5a-4618-b840-59039ed50492', 'attached_at': '2023-11-28T18:44:08.000000', 'detached_at': '', 'volume_id': '8edef2a2-3c2d-4a41-993e-f47d082e848b', 'serial': '8edef2a2-3c2d-4a41-993e-f47d082e848b'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '581a017f-1620-4d48-9b57-86efa434b2a7', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:44:08 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:44:08 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:44:08 user nova-compute[75203]: INFO nova.compute.manager [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Shelve offloading
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:44:08 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:44:08 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:44:08 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance destroyed successfully.
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquired lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d43e4c-8f71-45f9-9131-5945968827ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:44:08 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc02cc-1f0f-433a-a8c7-698323dc325f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b] added
Nov 28 18:44:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f42e60-d332-424e-bb5d-2fb4ac087f0b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cee703-8f9c-4a17-b11f-ad16577fd9be]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVYPrlp {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVYPrlp" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269a117-00b4-49a0-9911-f197bcd5d821]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HWVYPrlp'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cc2d17-0d53-4434-af9c-00365ce0d695]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc23026d-c18e-4502-8761-24a86fed4f62]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 18:44:08 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 18:44:08 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:44:08 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 18:44:08 user nova-compute[75203]: 
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e43556-e615-4ceb-8fec-a1edf30497d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]
Nov 28 18:44:08 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.
Nov 28 18:44:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[11980009-32a4-419a-a339-dd32ed23d601]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e3d66f-20a3-4509-8e1e-f4dcfb9888c3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb17ca-c714-4f7f-8809-8aa47d1c6053]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:44:08 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Releasing lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpyGYmAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:44:09 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:44:09 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance destroyed successfully.
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'resources' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391113207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391113207',id=21,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF9J3+Pzh3OKq4qmB7UoBTdy5lbcXGZFqgbDYOeKGR4db0mKBRX00rn92bjaSFSQz+YAMZjp1Gjlh5lgBDMBtwFUYzdHacd0OhSvQl1NzZpoh+RS0+yEauRaLtPpl1jLA==',key_name='tempest-keypair-743467751',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-jmyn900h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member',shelved_at='2023-11-28T18:44:08.346108',shelved_host='user',shelved_image_id='4f75d139-9325-4be7-9df7-0dbfa739f511'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:44:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=23ad8585-7fca-4c5b-b0d7-1258eb331c39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_vif [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc046f13-06, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=865c376e-0059-44db-bd22-7bbfd7b687a7) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: INFO os_vif [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06')
Nov 28 18:44:09 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Deleting instance files /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39_del
Nov 28 18:44:09 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Deletion of /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39_del complete
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.compute.manager [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing instance network info cache due to event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] Acquiring lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] Acquired lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:44:09 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Deleted allocations for instance 23ad8585-7fca-4c5b-b0d7-1258eb331c39
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'numa_topology' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.objects.base [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<23ad8585-7fca-4c5b-b0d7-1258eb331c39> lazy-loaded attributes: resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23366353862323563', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366353862323563', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.650s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:44:09 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:44:09 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-97127879-network", "vif_mac": "fa:16:3e:7e:8f:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-97127879-network", "vif_mac": "fa:16:3e:7e:8f:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:44:09 user nova-compute[75203]:   <uuid>449f7a33-7a5a-4618-b840-59039ed50492</uuid>
Nov 28 18:44:09 user nova-compute[75203]:   <name>instance-00000012</name>
Nov 28 18:44:09 user nova-compute[75203]:   <memory>2097152</memory>
Nov 28 18:44:09 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:44:09 user nova-compute[75203]:   <metadata>
Nov 28 18:44:09 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:44:09 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:44:09 user nova-compute[75203]:       <nova:name>tempest-ServerActionsTestOtherB-server-937811796</nova:name>
Nov 28 18:44:09 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:44:08</nova:creationTime>
Nov 28 18:44:09 user nova-compute[75203]:       <nova:flavor name="m1.small">
Nov 28 18:44:09 user nova-compute[75203]:         <nova:memory>2048</nova:memory>
Nov 28 18:44:09 user nova-compute[75203]:         <nova:disk>20</nova:disk>
Nov 28 18:44:09 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:44:09 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:44:09 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:44:09 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:44:09 user nova-compute[75203]:       <nova:owner>
Nov 28 18:44:09 user nova-compute[75203]:         <nova:user uuid="c6695b6171894c0ab01d4f5e64af03ba">tempest-ServerActionsTestOtherB-1400740793-project-member</nova:user>
Nov 28 18:44:09 user nova-compute[75203]:         <nova:project uuid="6c45c2671f2344fc93f3f578c8ebf0f0">tempest-ServerActionsTestOtherB-1400740793</nova:project>
Nov 28 18:44:09 user nova-compute[75203]:       </nova:owner>
Nov 28 18:44:09 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:44:09 user nova-compute[75203]:       <nova:ports>
Nov 28 18:44:09 user nova-compute[75203]:         <nova:port uuid="51986925-f22e-4528-b519-836232111180">
Nov 28 18:44:09 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 18:44:09 user nova-compute[75203]:         </nova:port>
Nov 28 18:44:09 user nova-compute[75203]:       </nova:ports>
Nov 28 18:44:09 user nova-compute[75203]:     </nova:instance>
Nov 28 18:44:09 user nova-compute[75203]:   </metadata>
Nov 28 18:44:09 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:44:09 user nova-compute[75203]:     <system>
Nov 28 18:44:09 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:44:09 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:44:09 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:44:09 user nova-compute[75203]:       <entry name="serial">449f7a33-7a5a-4618-b840-59039ed50492</entry>
Nov 28 18:44:09 user nova-compute[75203]:       <entry name="uuid">449f7a33-7a5a-4618-b840-59039ed50492</entry>
Nov 28 18:44:09 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:44:09 user nova-compute[75203]:     </system>
Nov 28 18:44:09 user nova-compute[75203]:   </sysinfo>
Nov 28 18:44:09 user nova-compute[75203]:   <os>
Nov 28 18:44:09 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:44:09 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:44:09 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:44:09 user nova-compute[75203]:   </os>
Nov 28 18:44:09 user nova-compute[75203]:   <features>
Nov 28 18:44:09 user nova-compute[75203]:     <acpi/>
Nov 28 18:44:09 user nova-compute[75203]:     <apic/>
Nov 28 18:44:09 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:44:09 user nova-compute[75203]:   </features>
Nov 28 18:44:09 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:44:09 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:44:09 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:44:09 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:44:09 user nova-compute[75203]:   </clock>
Nov 28 18:44:09 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:44:09 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:44:09 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:44:09 user nova-compute[75203]:   </cpu>
Nov 28 18:44:09 user nova-compute[75203]:   <devices>
Nov 28 18:44:09 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:44:09 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:44:09 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk"/>
Nov 28 18:44:09 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:44:09 user nova-compute[75203]:     </disk>
Nov 28 18:44:09 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:44:09 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:44:09 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 18:44:09 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:44:09 user nova-compute[75203]:       <serial>8edef2a2-3c2d-4a41-993e-f47d082e848b</serial>
Nov 28 18:44:09 user nova-compute[75203]:     </disk>
Nov 28 18:44:09 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:44:09 user nova-compute[75203]:       <mac address="fa:16:3e:7e:8f:c7"/>
Nov 28 18:44:09 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:44:09 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:44:09 user nova-compute[75203]:       <target dev="tap51986925-f2"/>
Nov 28 18:44:09 user nova-compute[75203]:     </interface>
Nov 28 18:44:09 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:44:09 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/console.log" append="off"/>
Nov 28 18:44:09 user nova-compute[75203]:     </serial>
Nov 28 18:44:09 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:44:09 user nova-compute[75203]:     <video>
Nov 28 18:44:09 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:44:09 user nova-compute[75203]:     </video>
Nov 28 18:44:09 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:44:09 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:44:09 user nova-compute[75203]:     </rng>
Nov 28 18:44:09 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:44:09 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:44:09 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:44:09 user nova-compute[75203]:     </memballoon>
Nov 28 18:44:09 user nova-compute[75203]:   </devices>
Nov 28 18:44:09 user nova-compute[75203]: </domain>
Nov 28 18:44:09 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:40:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-97127879-network", "vif_mac": "fa:16:3e:7e:8f:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-97127879-network", "vif_mac": "fa:16:3e:7e:8f:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_vif [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ce044-0ae9-479a-9111-0cc7a760494f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:44:09 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '828c960f-68b2-5321-8d67-05dccf7c3270', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51986925-f2, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51986925-f2, col_values=(('qos', UUID('b7c0deb1-c704-49cc-808d-38fc45cc0d72')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51986925-f2, col_values=(('external_ids', {'iface-id': '51986925-f22e-4528-b519-836232111180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:8f:c7', 'vm-uuid': '449f7a33-7a5a-4618-b840-59039ed50492'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e273fa6-2fa1-4f65-9f3a-ec17d63012e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8] added
Nov 28 18:44:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:09 user nova-compute[75203]: INFO os_vif [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2')
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f33616-b315-4730-ba7c-8c343d40ede6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb34652-15e7-4cb5-8ec2-48349975e311]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpyGYmAq {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpyGYmAq" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761fe63-8ba2-4d2f-8af1-83f9101e48ab]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jpyGYmAq'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updated VIF entry in instance network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcc046f13-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] No VIF found with MAC fa:16:3e:7e:8f:c7, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db0ea37-e7ea-4966-8da8-6f8803573522]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8c48585b-16fd-43fc-98a6-5ca4b9b293ab req-c7aeed19-c850-4a19-80ff-bfd38433c3a8 service nova] Releasing lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aa28f1-b320-4230-86eb-1be367e922a6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5515b3a-bd61-487a-b598-830a1e894326]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260]
Nov 28 18:44:10 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260] successful.
Nov 28 18:44:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5a2042-ec3b-4dce-8619-4c613fc59c2a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea75f533-ddae-4deb-b007-9f33e6b453c2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:10 user nova-compute[75203]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 (non-flash)
Nov 28 18:44:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:10 user nova-compute[75203]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 (non-flash)
Nov 28 18:44:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f3d57-a94e-4298-b338-a4ca569235ef]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpyGYmAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3b1da18-9d30-4e0e-9276-30dc69c24f47 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.202s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== connect_volume: return (1990ms) {'type': 'block', 'scsi_wwn': '23734396633343465', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734396633343465', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:44:11 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:44:11 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:44:11 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:44:11 user nova-compute[75203]:   <serial>5e0ef794-69ae-478c-9f32-b32711acdbe8</serial>
Nov 28 18:44:11 user nova-compute[75203]: </disk>
Nov 28 18:44:11 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-ba1886f3-fab6-480c-b59c-a937169ab6b0 req-14ea2b47-8397-47b8-9cef-f9b44cb6d8a6 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ba1886f3-fab6-480c-b59c-a937169ab6b0 req-14ea2b47-8397-47b8-9cef-f9b44cb6d8a6 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ba1886f3-fab6-480c-b59c-a937169ab6b0 req-14ea2b47-8397-47b8-9cef-f9b44cb6d8a6 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ba1886f3-fab6-480c-b59c-a937169ab6b0 req-14ea2b47-8397-47b8-9cef-f9b44cb6d8a6 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-ba1886f3-fab6-480c-b59c-a937169ab6b0 req-14ea2b47-8397-47b8-9cef-f9b44cb6d8a6 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:44:11 user nova-compute[75203]: WARNING nova.compute.manager [req-ba1886f3-fab6-480c-b59c-a937169ab6b0 req-14ea2b47-8397-47b8-9cef-f9b44cb6d8a6 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state resize_finish.
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:44:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No VIF found with MAC fa:16:3e:cd:aa:27, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:44:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a726baf-0132-45f8-b737-a7f2918436da tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.279s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-0f855545-ae59-46d0-b340-9fc764a64934 req-9eaf8faa-4523-41f6-98aa-267e14fbab49 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0f855545-ae59-46d0-b340-9fc764a64934 req-9eaf8faa-4523-41f6-98aa-267e14fbab49 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0f855545-ae59-46d0-b340-9fc764a64934 req-9eaf8faa-4523-41f6-98aa-267e14fbab49 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0f855545-ae59-46d0-b340-9fc764a64934 req-9eaf8faa-4523-41f6-98aa-267e14fbab49 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-0f855545-ae59-46d0-b340-9fc764a64934 req-9eaf8faa-4523-41f6-98aa-267e14fbab49 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:44:13 user nova-compute[75203]: WARNING nova.compute.manager [req-0f855545-ae59-46d0-b340-9fc764a64934 req-9eaf8faa-4523-41f6-98aa-267e14fbab49 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state resize_finish.
Nov 28 18:44:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:44:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance running successfully.
Nov 28 18:44:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Failed to set time: agent not configured {{(pid=75203) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 18:44:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-17d0294e-627d-41c5-92ac-cc1699796511 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] finish_migration finished successfully. {{(pid=75203) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 18:44:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:14 user nova-compute[75203]: INFO nova.compute.manager [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Detaching volume 5e0ef794-69ae-478c-9f32-b32711acdbe8
Nov 28 18:44:14 user nova-compute[75203]: INFO nova.virt.block_device [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attempting to driver detach volume 5e0ef794-69ae-478c-9f32-b32711acdbe8 from mountpoint /dev/vdb
Nov 28 18:44:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Attempting to detach device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:44:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:44:14 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:44:14 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:44:14 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:44:14 user nova-compute[75203]:   <serial>5e0ef794-69ae-478c-9f32-b32711acdbe8</serial>
Nov 28 18:44:14 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:44:14 user nova-compute[75203]: </disk>
Nov 28 18:44:14 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:44:14 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config.
Nov 28 18:44:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:44:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:44:14 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:44:14 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 18:44:14 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:44:14 user nova-compute[75203]:   <serial>5e0ef794-69ae-478c-9f32-b32711acdbe8</serial>
Nov 28 18:44:14 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:44:14 user nova-compute[75203]: </disk>
Nov 28 18:44:14 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:44:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:44:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:20 user nova-compute[75203]: INFO nova.compute.manager [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Terminating instance
Nov 28 18:44:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:44:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-885f5051-5452-4ef5-86ae-94e8156ce1ec req-f7c0cc5b-d0bf-41ea-a9c7-59e5655f275f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-unplugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-885f5051-5452-4ef5-86ae-94e8156ce1ec req-f7c0cc5b-d0bf-41ea-a9c7-59e5655f275f service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-885f5051-5452-4ef5-86ae-94e8156ce1ec req-f7c0cc5b-d0bf-41ea-a9c7-59e5655f275f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-885f5051-5452-4ef5-86ae-94e8156ce1ec req-f7c0cc5b-d0bf-41ea-a9c7-59e5655f275f service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-885f5051-5452-4ef5-86ae-94e8156ce1ec req-f7c0cc5b-d0bf-41ea-a9c7-59e5655f275f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-unplugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-885f5051-5452-4ef5-86ae-94e8156ce1ec req-f7c0cc5b-d0bf-41ea-a9c7-59e5655f275f service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-unplugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Instance destroyed successfully.
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'resources' on Instance uuid 43538aa1-3ebe-4098-bd42-78353ed457ce {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-883710891',display_name='tempest-ServerActionsTestOtherA-server-474315397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-883710891',id=15,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxCc6vEhlAeiMgyKG6RNZ45Sr0UQX//i1sndSdsS4E5kd+SCD4AsLEHMeWVxO7Y//0/zPvjjBK6YosabO12NQfr0oUb4HQ9Yrce4dAJs7I43Ckntfds0dUck6EybhVqjA==',key_name='tempest-keypair-839735458',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-3rnm27ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=43538aa1-3ebe-4098-bd42-78353ed457ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "address": "fa:16:3e:1a:23:1d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7fb7677-2b", "ovs_interfaceid": "a7fb7677-2bdc-4383-88b0-ba6caecb778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG os_vif [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7fb7677-2b, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=faac140c-22e4-4f06-8017-95b1537cee5d) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:21 user nova-compute[75203]: INFO os_vif [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:23:1d,bridge_name='br-int',has_traffic_filtering=True,id=a7fb7677-2bdc-4383-88b0-ba6caecb778a,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7fb7677-2b')
Nov 28 18:44:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Deleting instance files /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce_del
Nov 28 18:44:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Deletion of /opt/stack/data/nova/instances/43538aa1-3ebe-4098-bd42-78353ed457ce_del complete
Nov 28 18:44:21 user nova-compute[75203]: INFO nova.compute.manager [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 18:44:21 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:44:21 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:44:22 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:44:22 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Took 0.61 seconds to deallocate network for instance.
Nov 28 18:44:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:22 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:44:22 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:44:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:22 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Deleted allocations for instance 43538aa1-3ebe-4098-bd42-78353ed457ce
Nov 28 18:44:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4ddad93e-0a30-4e23-870e-3a2f52994bfd tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-6b412526-576a-4ea8-861d-7384817416cd req-f7cdd6f6-47b8-486a-84f9-40cbbee2b6df service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6b412526-576a-4ea8-861d-7384817416cd req-f7cdd6f6-47b8-486a-84f9-40cbbee2b6df service nova] Acquiring lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6b412526-576a-4ea8-861d-7384817416cd req-f7cdd6f6-47b8-486a-84f9-40cbbee2b6df service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6b412526-576a-4ea8-861d-7384817416cd req-f7cdd6f6-47b8-486a-84f9-40cbbee2b6df service nova] Lock "43538aa1-3ebe-4098-bd42-78353ed457ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-6b412526-576a-4ea8-861d-7384817416cd req-f7cdd6f6-47b8-486a-84f9-40cbbee2b6df service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] No waiting events found dispatching network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:44:23 user nova-compute[75203]: WARNING nova.compute.manager [req-6b412526-576a-4ea8-861d-7384817416cd req-f7cdd6f6-47b8-486a-84f9-40cbbee2b6df service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received unexpected event network-vif-plugged-a7fb7677-2bdc-4383-88b0-ba6caecb778a for instance with vm_state deleted and task_state None.
Nov 28 18:44:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-6b412526-576a-4ea8-861d-7384817416cd req-f7cdd6f6-47b8-486a-84f9-40cbbee2b6df service nova] [instance: 43538aa1-3ebe-4098-bd42-78353ed457ce] Received event network-vif-deleted-a7fb7677-2bdc-4383-88b0-ba6caecb778a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:34 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 is timed out.
Nov 28 18:44:34 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config.
Nov 28 18:44:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpyGYmAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:44:34 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3119cdf0-b60c-45ea-8da4-474e59c7022b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:44:34 user nova-compute[75203]: No targets found.
Nov 28 18:44:34 user nova-compute[75203]: iSNS:
Nov 28 18:44:34 user nova-compute[75203]: No targets found.
Nov 28 18:44:34 user nova-compute[75203]: STATIC:
Nov 28 18:44:34 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:44:34 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:44:34 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:44:34 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8
Nov 28 18:44:34 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:44:34 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:44:34 user nova-compute[75203]: FIRMWARE:
Nov 28 18:44:34 user nova-compute[75203]: No targets found.
Nov 28 18:44:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:44:34 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:44:34 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2064bb-a92c-43f1-9ae5-21f39d5ad563]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f635b5a-b0cd-4cf2-955d-da7ab09c00ed]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:34 user nova-compute[75203]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 (non-flash)
Nov 28 18:44:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:44:34 user nova-compute[75203]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 (non-flash)
Nov 28 18:44:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a825ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2279bd-4deb-4a0f-9770-207d2e6245d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3402d27-3b3a-469c-9333-9e69840f4f7f]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[676a7650-093a-4599-9f82-64709dd412b7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d2763-cc3a-4040-bd14-817985119f2e]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f3f5f-d6dc-40b2-a82a-722048dd3a41]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9464bd2-9eac-4c2b-b3fd-f40b6b2f7c32]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260]
Nov 28 18:44:34 user nova-compute[75203]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8, portal: 172.16.0.220,3260] successful.
Nov 28 18:44:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e0ef794-69ae-478c-9f32-b32711acdbe8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037cdf3-1a3f-4788-9b2d-75fe2a3302b2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== disconnect_volume: return (288ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:44:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:44:35 user nova-compute[75203]: DEBUG nova.objects.instance [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:44:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fef72725-6c6b-4406-a2ad-b5ba04bbb6ca tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.623s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:44:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:44:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:44:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:44:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:44:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7702MB free_disk=25.080089569091797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Applying migration context for instance 449f7a33-7a5a-4618-b840-59039ed50492 as it has an incoming, in-progress migration f8087fee-6858-4bd7-b1be-4bf58e6a4557. Migration status is finished {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 18:44:49 user nova-compute[75203]: INFO nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating resource usage from migration f8087fee-6858-4bd7-b1be-4bf58e6a4557
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 13524911-1006-4646-9c67-def22fb36ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 177bbb95-7d1b-4c19-b3fd-182653317455 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Migration f8087fee-6858-4bd7-b1be-4bf58e6a4557 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:44:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:44:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:44:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:44:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:44:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:44:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:44:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:44:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:44:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:44:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:44:57 user nova-compute[75203]: INFO nova.compute.claims [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Claim successful on node user
Nov 28 18:44:57 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:44:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:44:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:44:58 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:44:58 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:44:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:44:58 user nova-compute[75203]: INFO nova.virt.block_device [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Booting with blank volume at /dev/vda
Nov 28 18:44:58 user nova-compute[75203]: DEBUG nova.policy [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad9a9772df954da0b42b5b102440c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1aaec341d441fb4da4fc53a985617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Successfully created port: 9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Successfully updated port: 9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-changed-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Refreshing instance network info cache due to event network-changed-9d772bbd-714c-4603-9a31-3ed495ebc5a5. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] Acquiring lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating instance_info_cache with network_info: [{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance network_info: |[{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] Acquired lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:44:59 user nova-compute[75203]: DEBUG nova.network.neutron [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Refreshing network info cache for port 9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:45:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updated VIF entry in instance network info cache for port 9d772bbd-714c-4603-9a31-3ed495ebc5a5. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:45:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating instance_info_cache with network_info: [{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4657f918-39b6-4d85-b4cd-7d92b46b1237 req-20b21eb5-7d32-4c8e-a1b9-3b1f5a1ff4f9 service nova] Releasing lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG os_brick.utils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f9c71-0d55-4b6c-84d4-6e9c2057ab95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d675a185-af4c-4a04-be47-6a5133fa44e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ace222-3bce-4037-a4de-4f68a5f29dad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e58209-e768-4e94-ab5f-22feef63ca53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:03 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:45:03 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcca6de-272e-4b3e-ad43-b5a32a2c7b72]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG os_brick.utils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:03 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating existing volume attachment record: ef459e14-f7b7-4b80-83c2-9c0ec110e679 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:45:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.objects.instance [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing instance network info cache due to event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] Acquiring lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] Acquired lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:07 user nova-compute[75203]: INFO nova.compute.manager [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attaching volume d27eea56-9716-4e83-831c-bffd0d9cec6f to /dev/vdb
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[675eed1a-343e-4338-8e5e-91fc0f8fe070]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[364b4469-2652-473c-9dac-620fea080d81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea4aae-e197-4b42-a819-692110fd3548]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96faaec-beb3-45f0-96a9-2f23972be721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:07 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7327d1-67e0-4968-8ade-2f198c358424]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating existing volume attachment record: 7579dbce-265e-4c5c-ac2e-848352ee7254 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'flavor' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:07 user nova-compute[75203]: INFO nova.compute.manager [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Attaching volume 630c7d86-8370-40f1-8200-7cfe2c3045d2 to /dev/vdb
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updated VIF entry in instance network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70207867-4624-4ea1-b830-16c3614f3739 req-b5d73e15-e7d5-41ef-82e3-e0da94879f24 service nova] Releasing lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2a051a-fb8c-4d60-9922-dd3e8c1aaf75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d42c3fd-8b8b-4cf5-9bb1-6a625168f6b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f3a9a-fdd3-4183-9223-c334cfe57a84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6f3c73-7a74-4543-a897-aeebb1249e93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:07 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:45:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842a14f-ebc0-42d1-b94d-9ea8662192f4]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:07 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating existing volume attachment record: 091d7e15-ddff-4a4a-aa53-cccb4e7d3a23 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:45:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:45:11 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Creating image(s)
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Ensure instance console log exists: /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Start _get_guest_xml network_info=[{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyCxeuVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33b41c79-f029-473d-b6c8-8b3ec206be68', 'attached_at': '', 'detached_at': '', 'volume_id': '4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'serial': '4dc5ab62-885a-471f-af6d-e8fd39051f1e'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'ef459e14-f7b7-4b80-83c2-9c0ec110e679', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:45:11 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:11 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyCxeuVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:11 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:11 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:11 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[04499961-ffc3-4d94-9698-dc391fab40ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:45:11 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f008f25-fe1b-4fc7-9bf0-9d9d38651ef3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e] added
Nov 28 18:45:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e7e6a-8063-4209-a0bd-6e858610fa9c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1407cb5e-38b1-42ad-9b4a-2c50a3ca5006]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyCxeuVh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyCxeuVh" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c29af2b-1673-40dc-be54-96e8170ff6f9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gyCxeuVh'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5757df-6eb6-4085-b792-58fbde2c3de5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd468de0-47c3-4e14-b7c1-c148913f9622]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ee96ee-bc6b-42d6-9623-5780ec8cc801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260]
Nov 28 18:45:11 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8f568d-e9f5-4b0d-8696-4df0cce29a61]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f25dadc-0a35-493b-a983-7d9455b6a89c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:11 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:11 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0fd3d-5336-4d28-84f2-c7ce610c8161]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyCxeuVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:45:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23138666438643034', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138666438643034', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1657601046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1657601046',id=24,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-z19gbbkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:44:58Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=33b41c79-f029-473d-b6c8-8b3ec206be68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'pci_devices' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:45:12 user nova-compute[75203]:   <uuid>33b41c79-f029-473d-b6c8-8b3ec206be68</uuid>
Nov 28 18:45:12 user nova-compute[75203]:   <name>instance-00000018</name>
Nov 28 18:45:12 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:45:12 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:45:12 user nova-compute[75203]:   <metadata>
Nov 28 18:45:12 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:45:12 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:45:12 user nova-compute[75203]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1657601046</nova:name>
Nov 28 18:45:12 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:45:11</nova:creationTime>
Nov 28 18:45:12 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:45:12 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:45:12 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:45:12 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:45:12 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:45:12 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:45:12 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:45:12 user nova-compute[75203]:       <nova:owner>
Nov 28 18:45:12 user nova-compute[75203]:         <nova:user uuid="ad9a9772df954da0b42b5b102440c1d0">tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member</nova:user>
Nov 28 18:45:12 user nova-compute[75203]:         <nova:project uuid="eec1aaec341d441fb4da4fc53a985617">tempest-ServerBootFromVolumeStableRescueTest-1173209255</nova:project>
Nov 28 18:45:12 user nova-compute[75203]:       </nova:owner>
Nov 28 18:45:12 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:45:12 user nova-compute[75203]:       <nova:ports>
Nov 28 18:45:12 user nova-compute[75203]:         <nova:port uuid="9d772bbd-714c-4603-9a31-3ed495ebc5a5">
Nov 28 18:45:12 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 18:45:12 user nova-compute[75203]:         </nova:port>
Nov 28 18:45:12 user nova-compute[75203]:       </nova:ports>
Nov 28 18:45:12 user nova-compute[75203]:     </nova:instance>
Nov 28 18:45:12 user nova-compute[75203]:   </metadata>
Nov 28 18:45:12 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:45:12 user nova-compute[75203]:     <system>
Nov 28 18:45:12 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:45:12 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:45:12 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:45:12 user nova-compute[75203]:       <entry name="serial">33b41c79-f029-473d-b6c8-8b3ec206be68</entry>
Nov 28 18:45:12 user nova-compute[75203]:       <entry name="uuid">33b41c79-f029-473d-b6c8-8b3ec206be68</entry>
Nov 28 18:45:12 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:45:12 user nova-compute[75203]:     </system>
Nov 28 18:45:12 user nova-compute[75203]:   </sysinfo>
Nov 28 18:45:12 user nova-compute[75203]:   <os>
Nov 28 18:45:12 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:45:12 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:45:12 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:45:12 user nova-compute[75203]:   </os>
Nov 28 18:45:12 user nova-compute[75203]:   <features>
Nov 28 18:45:12 user nova-compute[75203]:     <acpi/>
Nov 28 18:45:12 user nova-compute[75203]:     <apic/>
Nov 28 18:45:12 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:45:12 user nova-compute[75203]:   </features>
Nov 28 18:45:12 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:45:12 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:45:12 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:45:12 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:45:12 user nova-compute[75203]:   </clock>
Nov 28 18:45:12 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:45:12 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:45:12 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:45:12 user nova-compute[75203]:   </cpu>
Nov 28 18:45:12 user nova-compute[75203]:   <devices>
Nov 28 18:45:12 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:45:12 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:12 user nova-compute[75203]:       <source dev="/dev/sdc"/>
Nov 28 18:45:12 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:45:12 user nova-compute[75203]:       <serial>4dc5ab62-885a-471f-af6d-e8fd39051f1e</serial>
Nov 28 18:45:12 user nova-compute[75203]:     </disk>
Nov 28 18:45:12 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:45:12 user nova-compute[75203]:       <mac address="fa:16:3e:9d:09:68"/>
Nov 28 18:45:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:45:12 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:45:12 user nova-compute[75203]:       <target dev="tap9d772bbd-71"/>
Nov 28 18:45:12 user nova-compute[75203]:     </interface>
Nov 28 18:45:12 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:45:12 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/console.log" append="off"/>
Nov 28 18:45:12 user nova-compute[75203]:     </serial>
Nov 28 18:45:12 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:45:12 user nova-compute[75203]:     <video>
Nov 28 18:45:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:45:12 user nova-compute[75203]:     </video>
Nov 28 18:45:12 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:45:12 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:45:12 user nova-compute[75203]:     </rng>
Nov 28 18:45:12 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:45:12 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:45:12 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:45:12 user nova-compute[75203]:     </memballoon>
Nov 28 18:45:12 user nova-compute[75203]:   </devices>
Nov 28 18:45:12 user nova-compute[75203]: </domain>
Nov 28 18:45:12 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1657601046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1657601046',id=24,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-z19gbbkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:44:58Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=33b41c79-f029-473d-b6c8-8b3ec206be68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG os_vif [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e27184c1-b491-5b04-95f7-c041cbacb379', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d772bbd-71, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d772bbd-71, col_values=(('qos', UUID('4a7a94d5-4611-4c7a-a176-f64a28eaf591')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d772bbd-71, col_values=(('external_ids', {'iface-id': '9d772bbd-714c-4603-9a31-3ed495ebc5a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:09:68', 'vm-uuid': '33b41c79-f029-473d-b6c8-8b3ec206be68'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:12 user nova-compute[75203]: INFO os_vif [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71')
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No VIF found with MAC fa:16:3e:9d:09:68, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:45:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-ef98c6b7-d9f5-42de-95a0-74d9d9c51479 req-fd1348cb-06a5-4c21-85d2-4c99168161a3 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ef98c6b7-d9f5-42de-95a0-74d9d9c51479 req-fd1348cb-06a5-4c21-85d2-4c99168161a3 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ef98c6b7-d9f5-42de-95a0-74d9d9c51479 req-fd1348cb-06a5-4c21-85d2-4c99168161a3 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ef98c6b7-d9f5-42de-95a0-74d9d9c51479 req-fd1348cb-06a5-4c21-85d2-4c99168161a3 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-ef98c6b7-d9f5-42de-95a0-74d9d9c51479 req-fd1348cb-06a5-4c21-85d2-4c99168161a3 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:14 user nova-compute[75203]: WARNING nova.compute.manager [req-ef98c6b7-d9f5-42de-95a0-74d9d9c51479 req-fd1348cb-06a5-4c21-85d2-4c99168161a3 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state building and task_state spawning.
Nov 28 18:45:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqkiMNVd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:14 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:14 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:14 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b33c97a-8cb2-4660-ba4b-5afe31253c4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:45:14 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b935668b-db74-42c5-bf78-7f83e137cf73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f] added
Nov 28 18:45:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ef81a3-d8b9-426f-8c50-c77a743dc28b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c681eaf0-972f-4bd3-bddd-631bbf4c8955]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqkiMNVd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqkiMNVd" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[922c8575-9e3c-4d92-aeb7-84abc4533a70]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eqkiMNVd'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6662a82b-43ae-4431-86f7-8b1b30ee9e56]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ae3b9b-a1f4-4fb2-98f5-02e6f7fe1e00]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:14 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:14 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21c3d26-c474-4b20-a10d-99871e5c3510]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260]
Nov 28 18:45:15 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:15 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9afc08-a02b-474d-a90b-ea5ffd9d4d42]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884598f-d2e5-4f2d-912b-11b78b49fd8e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:15 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:15 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:15 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:15 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:15 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:15 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yESrOzMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:15 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc017cfd-80da-450a-9a60-438e04160984]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:15 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqkiMNVd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26237303464303665', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237303464303665', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.020s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:16 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:16 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.objects.instance [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c143d23c-eb99-40bb-b443-8956f0d251aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:45:16 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:45:16 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:16 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 18:45:16 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:45:16 user nova-compute[75203]:   <serial>d27eea56-9716-4e83-831c-bffd0d9cec6f</serial>
Nov 28 18:45:16 user nova-compute[75203]: </disk>
Nov 28 18:45:16 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ad54b5-94ca-4047-8e61-784d7bba354e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2] added
Nov 28 18:45:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600d75d-b05e-4ac2-896c-9421127e9f4e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance spawned successfully.
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0959e6-0558-4b4f-9afd-fb3b4c83d284]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yESrOzMb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yESrOzMb" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c385239-0045-42ee-be88-4071e2798d44]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yESrOzMb'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0307f7b0-5710-4841-9059-792bc47d9a06]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b6cae7-0611-47d6-b14e-ee95327f42a6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: INFO nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-a4ffa02d-d553-4829-93a8-9009653b1ee9 req-3af8e81c-6001-4d4f-a700-62dda257aafc service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a4ffa02d-d553-4829-93a8-9009653b1ee9 req-3af8e81c-6001-4d4f-a700-62dda257aafc service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a4ffa02d-d553-4829-93a8-9009653b1ee9 req-3af8e81c-6001-4d4f-a700-62dda257aafc service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a4ffa02d-d553-4829-93a8-9009653b1ee9 req-3af8e81c-6001-4d4f-a700-62dda257aafc service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-a4ffa02d-d553-4829-93a8-9009653b1ee9 req-3af8e81c-6001-4d4f-a700-62dda257aafc service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:16 user nova-compute[75203]: WARNING nova.compute.manager [req-a4ffa02d-d553-4829-93a8-9009653b1ee9 req-3af8e81c-6001-4d4f-a700-62dda257aafc service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state building and task_state spawning.
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f64f19-f4a1-4d36-911e-9b79ece06212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260]
Nov 28 18:45:16 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: INFO nova.compute.manager [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Took 18.86 seconds to build instance.
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa5762d-5547-4a56-8650-d5fadc8ba8fe]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-eb3676c4-9c85-43a4-84a6-3fa178233e53 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.955s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39faeae-6e17-4d39-a813-9487b365af18]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:16 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[00183ef8-1b13-425e-9167-b06d7ec2323e]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yESrOzMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No VIF found with MAC fa:16:3e:cd:aa:27, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:45:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-33eb0664-4ed1-4aa8-8917-cfbb8bb540bb tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.441s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] <== connect_volume: return (2365ms) {'type': 'block', 'scsi_wwn': '23239653765623232', 'path': '/dev/sde'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239653765623232', 'path': '/dev/sde'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'flavor' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:45:17 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:17 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:45:17 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:45:17 user nova-compute[75203]:   <serial>630c7d86-8370-40f1-8200-7cfe2c3045d2</serial>
Nov 28 18:45:17 user nova-compute[75203]: </disk>
Nov 28 18:45:17 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No VIF found with MAC fa:16:3e:4b:cc:1a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:45:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1005e4d0-52df-4f46-b921-2f78afed58a2 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.342s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:18 user nova-compute[75203]: INFO nova.compute.manager [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Rescuing
Nov 28 18:45:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:19 user nova-compute[75203]: INFO nova.compute.manager [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Detaching volume d27eea56-9716-4e83-831c-bffd0d9cec6f
Nov 28 18:45:19 user nova-compute[75203]: INFO nova.virt.block_device [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attempting to driver detach volume d27eea56-9716-4e83-831c-bffd0d9cec6f from mountpoint /dev/vdb
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Attempting to detach device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:45:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:19 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 18:45:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:45:19 user nova-compute[75203]:   <serial>d27eea56-9716-4e83-831c-bffd0d9cec6f</serial>
Nov 28 18:45:19 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:45:19 user nova-compute[75203]: </disk>
Nov 28 18:45:19 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:45:19 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config.
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:45:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:19 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 18:45:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:45:19 user nova-compute[75203]:   <serial>d27eea56-9716-4e83-831c-bffd0d9cec6f</serial>
Nov 28 18:45:19 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:45:19 user nova-compute[75203]: </disk>
Nov 28 18:45:19 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.compute.manager [req-4c545551-aeec-4c6e-85fd-99fe3e7f59d1 req-46f3cd3f-b076-46fe-8d85-e1fb8f1eb5b8 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4c545551-aeec-4c6e-85fd-99fe3e7f59d1 req-46f3cd3f-b076-46fe-8d85-e1fb8f1eb5b8 service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4c545551-aeec-4c6e-85fd-99fe3e7f59d1 req-46f3cd3f-b076-46fe-8d85-e1fb8f1eb5b8 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4c545551-aeec-4c6e-85fd-99fe3e7f59d1 req-46f3cd3f-b076-46fe-8d85-e1fb8f1eb5b8 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:19 user nova-compute[75203]: DEBUG nova.compute.manager [req-4c545551-aeec-4c6e-85fd-99fe3e7f59d1 req-46f3cd3f-b076-46fe-8d85-e1fb8f1eb5b8 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:19 user nova-compute[75203]: WARNING nova.compute.manager [req-4c545551-aeec-4c6e-85fd-99fe3e7f59d1 req-46f3cd3f-b076-46fe-8d85-e1fb8f1eb5b8 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state active and task_state rescuing.
Nov 28 18:45:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance destroyed successfully.
Nov 28 18:45:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Attempting rescue
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75203) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:45:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Creating image(s)
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue" returned: 0 in 0.054s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'migration_context' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.base [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<13524911-1006-4646-9c67-def22fb36ac4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Start _get_guest_xml network_info=[{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:4b:cc:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'resources' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.base [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<13524911-1006-4646-9c67-def22fb36ac4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'numa_topology' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.base [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<13524911-1006-4646-9c67-def22fb36ac4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:20 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:20 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.base [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<13524911-1006-4646-9c67-def22fb36ac4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1420770283',display_name='tempest-ServerRescueNegativeTestJSON-server-1420770283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1420770283',id=22,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYqxDm1iqu7KJ8Zdx8M2rPxexXzFXDX5EicJ2fN3cU5P6guw7wY8B61FlpPlU88Nr0OX0nonX4l48XyofV5e3ZkWSmjfyEbPd5+NmuWaMN89mpHnmgjwUH5ahQB+tqjLA==',key_name='tempest-keypair-1064251055',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-7onh3nn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=13524911-1006-4646-9c67-def22fb36ac4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:4b:cc:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "vif_mac": "fa:16:3e:4b:cc:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'pci_devices' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.objects.base [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Object Instance<13524911-1006-4646-9c67-def22fb36ac4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:45:20 user nova-compute[75203]:   <uuid>13524911-1006-4646-9c67-def22fb36ac4</uuid>
Nov 28 18:45:20 user nova-compute[75203]:   <name>instance-00000016</name>
Nov 28 18:45:20 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:45:20 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:45:20 user nova-compute[75203]:   <metadata>
Nov 28 18:45:20 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:45:20 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:45:20 user nova-compute[75203]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1420770283</nova:name>
Nov 28 18:45:20 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:45:20</nova:creationTime>
Nov 28 18:45:20 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:45:20 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:45:20 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:45:20 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:45:20 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:45:20 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:45:20 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:45:20 user nova-compute[75203]:       <nova:owner>
Nov 28 18:45:20 user nova-compute[75203]:         <nova:user uuid="f96761cb11ad45b0bbc9a0435d3c0324">tempest-ServerRescueNegativeTestJSON-2096861107-project-member</nova:user>
Nov 28 18:45:20 user nova-compute[75203]:         <nova:project uuid="13d19b759f9948c9be9be5097069099b">tempest-ServerRescueNegativeTestJSON-2096861107</nova:project>
Nov 28 18:45:20 user nova-compute[75203]:       </nova:owner>
Nov 28 18:45:20 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:45:20 user nova-compute[75203]:       <nova:ports>
Nov 28 18:45:20 user nova-compute[75203]:         <nova:port uuid="93f2167d-e2f4-49cc-9a16-f423db7c60a9">
Nov 28 18:45:20 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 18:45:20 user nova-compute[75203]:         </nova:port>
Nov 28 18:45:20 user nova-compute[75203]:       </nova:ports>
Nov 28 18:45:20 user nova-compute[75203]:     </nova:instance>
Nov 28 18:45:20 user nova-compute[75203]:   </metadata>
Nov 28 18:45:20 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:45:20 user nova-compute[75203]:     <system>
Nov 28 18:45:20 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:45:20 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:45:20 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:45:20 user nova-compute[75203]:       <entry name="serial">13524911-1006-4646-9c67-def22fb36ac4</entry>
Nov 28 18:45:20 user nova-compute[75203]:       <entry name="uuid">13524911-1006-4646-9c67-def22fb36ac4</entry>
Nov 28 18:45:20 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:45:20 user nova-compute[75203]:     </system>
Nov 28 18:45:20 user nova-compute[75203]:   </sysinfo>
Nov 28 18:45:20 user nova-compute[75203]:   <os>
Nov 28 18:45:20 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:45:20 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:45:20 user nova-compute[75203]:   </os>
Nov 28 18:45:20 user nova-compute[75203]:   <features>
Nov 28 18:45:20 user nova-compute[75203]:     <acpi/>
Nov 28 18:45:20 user nova-compute[75203]:     <apic/>
Nov 28 18:45:20 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:45:20 user nova-compute[75203]:   </features>
Nov 28 18:45:20 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:45:20 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:45:20 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:45:20 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:45:20 user nova-compute[75203]:   </clock>
Nov 28 18:45:20 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:45:20 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:45:20 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:45:20 user nova-compute[75203]:   </cpu>
Nov 28 18:45:20 user nova-compute[75203]:   <devices>
Nov 28 18:45:20 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:45:20 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:45:20 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue"/>
Nov 28 18:45:20 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:45:20 user nova-compute[75203]:     </disk>
Nov 28 18:45:20 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:45:20 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:45:20 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk"/>
Nov 28 18:45:20 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:45:20 user nova-compute[75203]:     </disk>
Nov 28 18:45:20 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:45:20 user nova-compute[75203]:       <mac address="fa:16:3e:4b:cc:1a"/>
Nov 28 18:45:20 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:45:20 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:45:20 user nova-compute[75203]:       <target dev="tap93f2167d-e2"/>
Nov 28 18:45:20 user nova-compute[75203]:     </interface>
Nov 28 18:45:20 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:45:20 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/console.log" append="off"/>
Nov 28 18:45:20 user nova-compute[75203]:     </serial>
Nov 28 18:45:20 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:45:20 user nova-compute[75203]:     <video>
Nov 28 18:45:20 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:45:20 user nova-compute[75203]:     </video>
Nov 28 18:45:20 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:45:20 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:45:20 user nova-compute[75203]:     </rng>
Nov 28 18:45:20 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:45:20 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:45:20 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:45:20 user nova-compute[75203]:     </memballoon>
Nov 28 18:45:20 user nova-compute[75203]:   </devices>
Nov 28 18:45:20 user nova-compute[75203]: </domain>
Nov 28 18:45:20 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:45:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance destroyed successfully.
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] No VIF found with MAC fa:16:3e:4b:cc:1a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:45:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-4fdcc835-dd4d-4dac-ae6c-34a1e1262cdc req-07975b33-fcee-43b3-9088-0001907db04e service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fdcc835-dd4d-4dac-ae6c-34a1e1262cdc req-07975b33-fcee-43b3-9088-0001907db04e service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fdcc835-dd4d-4dac-ae6c-34a1e1262cdc req-07975b33-fcee-43b3-9088-0001907db04e service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4fdcc835-dd4d-4dac-ae6c-34a1e1262cdc req-07975b33-fcee-43b3-9088-0001907db04e service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-4fdcc835-dd4d-4dac-ae6c-34a1e1262cdc req-07975b33-fcee-43b3-9088-0001907db04e service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:21 user nova-compute[75203]: WARNING nova.compute.manager [req-4fdcc835-dd4d-4dac-ae6c-34a1e1262cdc req-07975b33-fcee-43b3-9088-0001907db04e service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state active and task_state rescuing.
Nov 28 18:45:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "interface-177bbb95-7d1b-4c19-b3fd-182653317455-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "interface-177bbb95-7d1b-4c19-b3fd-182653317455-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:22 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'flavor' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:23 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'pci_requests' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:23 user nova-compute[75203]: DEBUG nova.objects.base [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Object Instance<177bbb95-7d1b-4c19-b3fd-182653317455> lazy-loaded attributes: flavor,pci_requests {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:45:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:23 user nova-compute[75203]: DEBUG nova.policy [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ca19ed1c66845259ec4a7aac7b9d611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c1fcb569344efe86c3ef2744817065', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:45:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Successfully created port: affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-changed-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Refreshing instance network info cache due to event network-changed-aa825c53-e639-46d8-8e5c-91f08c239f9e. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Acquiring lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Acquired lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Refreshing network info cache for port aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cd1c2967-c7b3-4866-a07e-0d644df6609c tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Successfully updated port: affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-changed-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Refreshing instance network info cache due to event network-changed-affb0e49-4f17-4c2f-bc13-ac14942a1f0e. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] Acquiring lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updated VIF entry in instance network info cache for port aa825c53-e639-46d8-8e5c-91f08c239f9e. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Releasing lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:24 user nova-compute[75203]: WARNING nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state active and task_state rescuing.
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:24 user nova-compute[75203]: WARNING nova.compute.manager [req-e845fbca-703f-4800-b3f9-3bcd2a7a5cf1 req-6cb07a98-12b7-4572-9660-c21743781419 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state active and task_state rescuing.
Nov 28 18:45:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquired lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:24 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Releasing lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] Acquired lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Refreshing network info cache for port affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converting VIF {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG os_vif [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49ca6c5e-d5da-55fe-a862-11212d4ef6bf', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaffb0e49-4f, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaffb0e49-4f, col_values=(('qos', UUID('f0b1bf13-93af-46fa-8954-84650a7f1d70')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaffb0e49-4f, col_values=(('external_ids', {'iface-id': 'affb0e49-4f17-4c2f-bc13-ac14942a1f0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:81:29', 'vm-uuid': '177bbb95-7d1b-4c19-b3fd-182653317455'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: INFO os_vif [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f')
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converting VIF {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] attach device xml: <interface type="ethernet">
Nov 28 18:45:25 user nova-compute[75203]:   <mac address="fa:16:3e:c1:81:29"/>
Nov 28 18:45:25 user nova-compute[75203]:   <model type="virtio"/>
Nov 28 18:45:25 user nova-compute[75203]:   <mtu size="1442"/>
Nov 28 18:45:25 user nova-compute[75203]:   <target dev="tapaffb0e49-4f"/>
Nov 28 18:45:25 user nova-compute[75203]: </interface>
Nov 28 18:45:25 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No BDM found with device name hda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No VIF found with MAC fa:16:3e:19:2b:8d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:45:25 user nova-compute[75203]:   <nova:package version="0.0.0"/>
Nov 28 18:45:25 user nova-compute[75203]:   <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:45:25 user nova-compute[75203]:   <nova:creationTime>2023-11-28 18:45:25</nova:creationTime>
Nov 28 18:45:25 user nova-compute[75203]:   <nova:flavor name="m1.tiny">
Nov 28 18:45:25 user nova-compute[75203]:     <nova:memory>512</nova:memory>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:disk>1</nova:disk>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:swap>0</nova:swap>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:vcpus>1</nova:vcpus>
Nov 28 18:45:25 user nova-compute[75203]:   </nova:flavor>
Nov 28 18:45:25 user nova-compute[75203]:   <nova:owner>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:45:25 user nova-compute[75203]:   </nova:owner>
Nov 28 18:45:25 user nova-compute[75203]:   <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:45:25 user nova-compute[75203]:   <nova:ports>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:45:25 user nova-compute[75203]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:45:25 user nova-compute[75203]:     </nova:port>
Nov 28 18:45:25 user nova-compute[75203]:     <nova:port uuid="affb0e49-4f17-4c2f-bc13-ac14942a1f0e">
Nov 28 18:45:25 user nova-compute[75203]:       <nova:ip type="fixed" address="10.10.10.142" ipVersion="4"/>
Nov 28 18:45:25 user nova-compute[75203]:     </nova:port>
Nov 28 18:45:25 user nova-compute[75203]:   </nova:ports>
Nov 28 18:45:25 user nova-compute[75203]: </nova:instance>
Nov 28 18:45:25 user nova-compute[75203]:  {{(pid=75203) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d3e28d1b-ce86-4fd2-bf44-752e6f6bd25a tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "interface-177bbb95-7d1b-4c19-b3fd-182653317455-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.023s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.objects.instance [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'flavor' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updated VIF entry in instance network info cache for port affb0e49-4f17-4c2f-bc13-ac14942a1f0e. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4a17809-8523-4676-b505-4e7e52aa55b4 req-438d76e5-5e7f-467b-9c0d-c15632dcf1fc service nova] Releasing lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:26 user nova-compute[75203]: INFO nova.compute.manager [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Attaching volume a9dbb229-a341-4a0f-bc9f-3966856d869b to /dev/vdb
Nov 28 18:45:26 user nova-compute[75203]: DEBUG os_brick.utils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4b8fea-4f0e-43b1-ac6a-a89ae7f6d135]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee05b58-bcf9-4465-869f-d92a532d6f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f09980c-7007-488b-aef4-7898daccaa58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a65b06-8ea0-47a6-86da-ca03bdbb941c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:26 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5e0a07-fb60-415b-8134-ddf1fb27f804]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG os_brick.utils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating existing volume attachment record: 0b69212d-4fca-4d21-a140-92d09a32a3b5 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:26 user nova-compute[75203]: WARNING nova.compute.manager [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received unexpected event network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e for instance with vm_state active and task_state None.
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:26 user nova-compute[75203]: WARNING nova.compute.manager [req-a548d219-6488-4277-ab5f-48fac6bb1e17 req-9078f757-acf6-4598-9692-956a23472567 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received unexpected event network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e for instance with vm_state active and task_state None.
Nov 28 18:45:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgWSyDXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:34 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:34 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:34 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcedae5-7305-4832-964b-3dce79c7d604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:45:34 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7021a227-09be-4491-bc02-aa22edfe9f25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b] added
Nov 28 18:45:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbdf108-980b-4677-914f-b859be88eba4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[03513279-e644-41d3-8917-c5ec334d7f58]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tgWSyDXz {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tgWSyDXz" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3ae457-76d5-4460-9ec9-47aefd7e12c0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tgWSyDXz'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[560251b5-6386-4479-b954-97140b641bb8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf701ba-af23-4768-950a-9efe90c09844]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e79411b-3926-4ed9-a1e4-b30f2a179bf8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260]
Nov 28 18:45:34 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f3bc2-b18b-4ae4-b1d3-e7ee859ccd68]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[affab0e2-62b5-44f3-b832-bc3814dbe951]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:34 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:34 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3307397e-cd31-4780-825a-0ac0d0c83197]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:45:34 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgWSyDXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26230653337633031', 'path': '/dev/sdf'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230653337633031', 'path': '/dev/sdf'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG nova.objects.instance [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'flavor' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:45:35 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:35 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:45:35 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:45:35 user nova-compute[75203]:   <serial>a9dbb229-a341-4a0f-bc9f-3966856d869b</serial>
Nov 28 18:45:35 user nova-compute[75203]: </disk>
Nov 28 18:45:35 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No BDM found with device name hda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:45:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] No VIF found with MAC fa:16:3e:19:2b:8d, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:45:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-31de43bc-0516-4777-aae5-3338c0c32227 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.597s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:36 user nova-compute[75203]: INFO nova.compute.manager [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Detaching volume a9dbb229-a341-4a0f-bc9f-3966856d869b
Nov 28 18:45:36 user nova-compute[75203]: INFO nova.virt.block_device [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Attempting to driver detach volume a9dbb229-a341-4a0f-bc9f-3966856d869b from mountpoint /dev/vdb
Nov 28 18:45:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Attempting to detach device vdb from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:45:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:45:36 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:36 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:45:36 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:45:36 user nova-compute[75203]:   <serial>a9dbb229-a341-4a0f-bc9f-3966856d869b</serial>
Nov 28 18:45:36 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 18:45:36 user nova-compute[75203]: </disk>
Nov 28 18:45:36 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:45:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully detached device vdb from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the persistent domain config.
Nov 28 18:45:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:45:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:45:36 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:36 user nova-compute[75203]:   <source dev="/dev/sdf"/>
Nov 28 18:45:36 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:45:36 user nova-compute[75203]:   <serial>a9dbb229-a341-4a0f-bc9f-3966856d869b</serial>
Nov 28 18:45:36 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 18:45:36 user nova-compute[75203]: </disk>
Nov 28 18:45:36 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:45:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:45:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 18:45:39 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 is timed out.
Nov 28 18:45:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config.
Nov 28 18:45:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqkiMNVd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e45ac6-90c4-46cc-96c5-34a95a9edbb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:45:39 user nova-compute[75203]: No targets found.
Nov 28 18:45:39 user nova-compute[75203]: iSNS:
Nov 28 18:45:39 user nova-compute[75203]: No targets found.
Nov 28 18:45:39 user nova-compute[75203]: STATIC:
Nov 28 18:45:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b
Nov 28 18:45:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f
Nov 28 18:45:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:45:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:45:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:45:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:39 user nova-compute[75203]: FIRMWARE:
Nov 28 18:45:39 user nova-compute[75203]: No targets found.
Nov 28 18:45:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:45:39 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:45:39 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee0e70f-7a9b-4c08-afcf-fb6377a76377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[576b864d-c7cd-42fc-a2c4-11528aff079f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:39 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903c3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f'): ({'sdd'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Removing single pathed devices sdd {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb46770-b96e-46e0-94ae-5ceb02e326b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e254c9-940f-414c-94d3-b0357e077602]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Flushing IO for device /dev/sdd {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc5a87-7e77-4efe-a317-74130f6e3183]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:45:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0703f2-1a7b-4904-bca8-ea3bb9724b67]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8f509f-6b53-49a0-a690-901ca139a651]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c04e12-a332-4c8c-9abc-d9854f06f827]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260]
Nov 28 18:45:40 user nova-compute[75203]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d27eea56-9716-4e83-831c-bffd0d9cec6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3875f97-82dc-41ac-87c8-c011c9e878e6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== disconnect_volume: return (315ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG nova.objects.instance [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d9df75-38ba-4bf1-9087-da31d736e0b7 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.659s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Port 51986925-f22e-4528-b519-836232111180 binding to destination host user is already ACTIVE {{(pid=75203) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Creating tmpfile /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/tmp3_5jdkir to verify with other compute node that the instance is on the same shared storage. {{(pid=75203) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-62bf2b26-9259-4e4e-903b-6b9a42dda0a6 req-f29ab4f1-5da8-4cef-9b23-4800ecaddeff service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62bf2b26-9259-4e4e-903b-6b9a42dda0a6 req-f29ab4f1-5da8-4cef-9b23-4800ecaddeff service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62bf2b26-9259-4e4e-903b-6b9a42dda0a6 req-f29ab4f1-5da8-4cef-9b23-4800ecaddeff service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62bf2b26-9259-4e4e-903b-6b9a42dda0a6 req-f29ab4f1-5da8-4cef-9b23-4800ecaddeff service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-62bf2b26-9259-4e4e-903b-6b9a42dda0a6 req-f29ab4f1-5da8-4cef-9b23-4800ecaddeff service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:46 user nova-compute[75203]: WARNING nova.compute.manager [req-62bf2b26-9259-4e4e-903b-6b9a42dda0a6 req-f29ab4f1-5da8-4cef-9b23-4800ecaddeff service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance destroyed successfully.
Nov 28 18:45:46 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lazy-loading 'resources' on Instance uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_vif [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51986925-f2, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7c0deb1-c704-49cc-808d-38fc45cc0d72) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:46 user nova-compute[75203]: INFO os_vif [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2')
Nov 28 18:45:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:46 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e03fe-7e78-4d9b-aa94-8d26d48cb75e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:45:46 user nova-compute[75203]: No targets found.
Nov 28 18:45:46 user nova-compute[75203]: iSNS:
Nov 28 18:45:46 user nova-compute[75203]: No targets found.
Nov 28 18:45:46 user nova-compute[75203]: STATIC:
Nov 28 18:45:46 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b
Nov 28 18:45:46 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:46 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:46 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:45:46 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:46 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:46 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:45:46 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:46 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:46 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:45:46 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:46 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:46 user nova-compute[75203]: FIRMWARE:
Nov 28 18:45:46 user nova-compute[75203]: No targets found.
Nov 28 18:45:46 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:45:46 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:45:46 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e646b5a2-5ede-40d5-808a-901e1aa96bf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fdb5e0-4620-4e1a-8dc8-8c47da4fcfde]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:46 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:46 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:46 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:46 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:46 user nova-compute[75203]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:46 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:46 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:46 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07902a0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c541e-0c29-4785-bff5-88f0c1dd1e5a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1663b5e3-9216-4264-aaef-ace274ffd877]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[47142359-ca8a-444c-9f0b-38ce86870c00]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fac276b-468c-4315-a001-4e106606cb05]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1a63be-e0f9-45ab-8b7f-38310aea01e0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff81dab-043f-4c93-93dc-04194f1075b9]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]
Nov 28 18:45:47 user nova-compute[75203]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c9d14a-5f52-4a74-8480-b03efc04f5f9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== disconnect_volume: return (405ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '449f7a33-7a5a-4618-b840-59039ed50492' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '449f7a33-7a5a-4618-b840-59039ed50492' (instance-00000012)
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lazy-loading 'migration_context' on Instance uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:48 user nova-compute[75203]: WARNING nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:48 user nova-compute[75203]: WARNING nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:48 user nova-compute[75203]: WARNING nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:48 user nova-compute[75203]: WARNING nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:45:48 user nova-compute[75203]: WARNING nova.compute.manager [req-f0225fb5-7577-4619-9c1c-cfa4f955c7e2 req-fa74c908-910a-4872-ae0c-16895e15fc40 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.objects.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Object Instance<449f7a33-7a5a-4618-b840-59039ed50492> lazy-loaded attributes: resources,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.608s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:49 user nova-compute[75203]: INFO nova.compute.manager [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Swapping old allocation on dict_keys(['124a0dbb-54e7-4217-a850-c2ea3ab9818b']) held by migration f8087fee-6858-4bd7-b1be-4bf58e6a4557 for instance
Nov 28 18:45:49 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Overwriting current allocation {'allocations': {'124a0dbb-54e7-4217-a850-c2ea3ab9818b': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 29}}, 'project_id': '6c45c2671f2344fc93f3f578c8ebf0f0', 'user_id': 'c6695b6171894c0ab01d4f5e64af03ba', 'consumer_generation': 1} on consumer 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG os_brick.utils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[baafd11d-00e0-4f49-99d0-2aa4a35342bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c48c1-7620-4c4c-bb2b-ad1439422e75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c744ee6-1465-4aac-bc41-60b2c2403e41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d00589-6283-4619-bddf-fadfe3cd7c32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:45:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.067794799804688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:45:50 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d73640-2f0f-4cda-ae7f-f1a074dcd84c]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG os_brick.utils [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== get_connector_properties: return (511ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 13524911-1006-4646-9c67-def22fb36ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 177bbb95-7d1b-4c19-b3fd-182653317455 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 18:45:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:51 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:45:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:45:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Updating instance_info_cache with network_info: [{"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:45:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:56 user nova-compute[75203]: INFO nova.compute.manager [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Unshelving
Nov 28 18:45:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG nova.objects.instance [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'pci_requests' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG nova.objects.instance [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'numa_topology' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:56 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:45:56 user nova-compute[75203]: INFO nova.compute.claims [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Claim successful on node user
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:57 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 177bbb95-7d1b-4c19-b3fd-182653317455 is timed out.
Nov 28 18:45:57 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully detached device vdb from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the live domain config.
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgWSyDXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:57 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:57 user nova-compute[75203]: INFO nova.network.neutron [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating port cc046f13-0661-4704-b2ba-6b22fc72c2b3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[09777b7c-b358-4ffc-9f5e-8e6451457cd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:45:57 user nova-compute[75203]: No targets found.
Nov 28 18:45:57 user nova-compute[75203]: iSNS:
Nov 28 18:45:57 user nova-compute[75203]: No targets found.
Nov 28 18:45:57 user nova-compute[75203]: STATIC:
Nov 28 18:45:57 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b
Nov 28 18:45:57 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:57 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:57 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:45:57 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:57 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:57 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:45:57 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:45:57 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:45:57 user nova-compute[75203]: FIRMWARE:
Nov 28 18:45:57 user nova-compute[75203]: No targets found.
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:45:57 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:45:57 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[14991a47-3895-4883-aea1-c011fe61ca9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a034153-9734-4f84-ad51-8a123a072a2b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b (non-flash)
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07904568c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b'): ({'sdf'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Removing single pathed devices sdf {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7363d654-ce82-4457-9df4-acf9a3d204ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Starting finish_revert_migration {{(pid=75203) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a78d51-6118-4efc-86ed-6470fb415503]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Flushing IO for device /dev/sdf {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Start _get_guest_xml network_info=[{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '449f7a33-7a5a-4618-b840-59039ed50492', 'attached_at': '2023-11-28T18:45:57.000000', 'detached_at': '', 'volume_id': '8edef2a2-3c2d-4a41-993e-f47d082e848b', 'serial': '8edef2a2-3c2d-4a41-993e-f47d082e848b'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'ef5ccf9a-133d-4fbe-9027-2911ba9d3414', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:45:57 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:57 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[218bbb25-edbd-49f0-9df8-0f505600b303]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lazy-loading 'vcpu_model' on Instance uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:45:57 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e4aef-6a49-432f-9955-eb4361944368]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b114e34c-c959-4f7b-8d19-9162e315e0da]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e7d33-6dc5-4d10-91b7-dbac4d4c05c1]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260]
Nov 28 18:45:57 user nova-compute[75203]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9dbb229-a341-4a0f-bc9f-3966856d869b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081467e-5273-4c11-be59-3915f54cd321]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] <== disconnect_volume: return (318ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.128s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:57 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:45:57 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aea1b1-f6c3-4b95-a49c-dfca55791f5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:45:57 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2ad8df-e1bf-471c-a7cd-8ebdf502da8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b] added
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[de482f00-95a2-4e65-afe1-e9e8177f2ec1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58122d7-df3f-468d-97cd-4e13e94991d1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVYPrlp {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVYPrlp" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d43a68-2fd5-4422-aba5-8f3df7a0c835]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HWVYPrlp'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9560ecf4-cc7d-4b2a-8fb7-1b6b880ed6ef]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c02ab80-2a4f-4bf4-a4fc-fa8a854cd265]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b70989-bc5a-4026-b70f-1434e93227a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]
Nov 28 18:45:57 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquired lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG nova.network.neutron [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c3432c-6b3e-4c5d-943a-0c5e0e147d59]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e5718b-0bec-4c4a-b019-bc47dee450a4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:45:57 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:45:57 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing instance network info cache due to event network-changed-cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] Acquiring lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf3acf2-e082-437b-9a28-2bce80b98412]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.network.neutron [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Releasing lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:45:58 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Creating image(s)
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.objects.instance [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'trusted_certs' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] Acquired lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.network.neutron [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Refreshing network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.objects.base [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<23ad8585-7fca-4c5b-b0d7-1258eb331c39> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:58 user nova-compute[75203]: DEBUG nova.objects.instance [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'flavor' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.590s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== connect_volume: return (1719ms) {'type': 'block', 'scsi_wwn': '23366353862323563', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366353862323563', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-990f128d-7593-4dd9-b269-17726b419310 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.489s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:45:59 user nova-compute[75203]:   <uuid>449f7a33-7a5a-4618-b840-59039ed50492</uuid>
Nov 28 18:45:59 user nova-compute[75203]:   <name>instance-00000012</name>
Nov 28 18:45:59 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:45:59 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:45:59 user nova-compute[75203]:   <metadata>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:45:59 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:45:59 user nova-compute[75203]:       <nova:name>tempest-ServerActionsTestOtherB-server-937811796</nova:name>
Nov 28 18:45:59 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:45:57</nova:creationTime>
Nov 28 18:45:59 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:45:59 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:45:59 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:45:59 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:45:59 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:45:59 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:45:59 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:45:59 user nova-compute[75203]:       <nova:owner>
Nov 28 18:45:59 user nova-compute[75203]:         <nova:user uuid="c6695b6171894c0ab01d4f5e64af03ba">tempest-ServerActionsTestOtherB-1400740793-project-member</nova:user>
Nov 28 18:45:59 user nova-compute[75203]:         <nova:project uuid="6c45c2671f2344fc93f3f578c8ebf0f0">tempest-ServerActionsTestOtherB-1400740793</nova:project>
Nov 28 18:45:59 user nova-compute[75203]:       </nova:owner>
Nov 28 18:45:59 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:45:59 user nova-compute[75203]:       <nova:ports>
Nov 28 18:45:59 user nova-compute[75203]:         <nova:port uuid="51986925-f22e-4528-b519-836232111180">
Nov 28 18:45:59 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 28 18:45:59 user nova-compute[75203]:         </nova:port>
Nov 28 18:45:59 user nova-compute[75203]:       </nova:ports>
Nov 28 18:45:59 user nova-compute[75203]:     </nova:instance>
Nov 28 18:45:59 user nova-compute[75203]:   </metadata>
Nov 28 18:45:59 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:45:59 user nova-compute[75203]:     <system>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name="serial">449f7a33-7a5a-4618-b840-59039ed50492</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name="uuid">449f7a33-7a5a-4618-b840-59039ed50492</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:45:59 user nova-compute[75203]:     </system>
Nov 28 18:45:59 user nova-compute[75203]:   </sysinfo>
Nov 28 18:45:59 user nova-compute[75203]:   <os>
Nov 28 18:45:59 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:45:59 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:45:59 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:45:59 user nova-compute[75203]:   </os>
Nov 28 18:45:59 user nova-compute[75203]:   <features>
Nov 28 18:45:59 user nova-compute[75203]:     <acpi/>
Nov 28 18:45:59 user nova-compute[75203]:     <apic/>
Nov 28 18:45:59 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:45:59 user nova-compute[75203]:   </features>
Nov 28 18:45:59 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:45:59 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:45:59 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:45:59 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:45:59 user nova-compute[75203]:   </clock>
Nov 28 18:45:59 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:45:59 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:45:59 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:45:59 user nova-compute[75203]:   </cpu>
Nov 28 18:45:59 user nova-compute[75203]:   <devices>
Nov 28 18:45:59 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:45:59 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:45:59 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk"/>
Nov 28 18:45:59 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:45:59 user nova-compute[75203]:     </disk>
Nov 28 18:45:59 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:45:59 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:45:59 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 18:45:59 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:45:59 user nova-compute[75203]:       <serial>8edef2a2-3c2d-4a41-993e-f47d082e848b</serial>
Nov 28 18:45:59 user nova-compute[75203]:     </disk>
Nov 28 18:45:59 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:45:59 user nova-compute[75203]:       <mac address="fa:16:3e:7e:8f:c7"/>
Nov 28 18:45:59 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:45:59 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:45:59 user nova-compute[75203]:       <target dev="tap51986925-f2"/>
Nov 28 18:45:59 user nova-compute[75203]:     </interface>
Nov 28 18:45:59 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:45:59 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/console.log" append="off"/>
Nov 28 18:45:59 user nova-compute[75203]:     </serial>
Nov 28 18:45:59 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:45:59 user nova-compute[75203]:     <video>
Nov 28 18:45:59 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:45:59 user nova-compute[75203]:     </video>
Nov 28 18:45:59 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:45:59 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:45:59 user nova-compute[75203]:     </rng>
Nov 28 18:45:59 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:45:59 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:45:59 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:45:59 user nova-compute[75203]:     </memballoon>
Nov 28 18:45:59 user nova-compute[75203]:   </devices>
Nov 28 18:45:59 user nova-compute[75203]: </domain>
Nov 28 18:45:59 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG os_vif [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '828c960f-68b2-5321-8d67-05dccf7c3270', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51986925-f2, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51986925-f2, col_values=(('qos', UUID('9510bfdd-68d8-42b6-840e-eb79b65e3a46')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51986925-f2, col_values=(('external_ids', {'iface-id': '51986925-f22e-4528-b519-836232111180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:8f:c7', 'vm-uuid': '449f7a33-7a5a-4618-b840-59039ed50492'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:59 user nova-compute[75203]: INFO os_vif [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2')
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "interface-177bbb95-7d1b-4c19-b3fd-182653317455-affb0e49-4f17-4c2f-bc13-ac14942a1f0e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "interface-177bbb95-7d1b-4c19-b3fd-182653317455-affb0e49-4f17-4c2f-bc13-ac14942a1f0e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'flavor' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.images [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] 4f75d139-9325-4be7-9df7-0dbfa739f511 was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.part /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converting VIF {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface> {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface> {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Attempting to detach device tapaffb0e49-4f from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] detach device xml: <interface type="ethernet">
Nov 28 18:45:59 user nova-compute[75203]:   <mac address="fa:16:3e:c1:81:29"/>
Nov 28 18:45:59 user nova-compute[75203]:   <model type="virtio"/>
Nov 28 18:45:59 user nova-compute[75203]:   <mtu size="1442"/>
Nov 28 18:45:59 user nova-compute[75203]:   <target dev="tapaffb0e49-4f"/>
Nov 28 18:45:59 user nova-compute[75203]: </interface>
Nov 28 18:45:59 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface> {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 28 18:45:59 user nova-compute[75203]:   <name>instance-00000017</name>
Nov 28 18:45:59 user nova-compute[75203]:   <uuid>177bbb95-7d1b-4c19-b3fd-182653317455</uuid>
Nov 28 18:45:59 user nova-compute[75203]:   <metadata>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:45:59 user nova-compute[75203]:   <nova:package version="0.0.0"/>
Nov 28 18:45:59 user nova-compute[75203]:   <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:45:59 user nova-compute[75203]:   <nova:creationTime>2023-11-28 18:45:25</nova:creationTime>
Nov 28 18:45:59 user nova-compute[75203]:   <nova:flavor name="m1.tiny">
Nov 28 18:45:59 user nova-compute[75203]:     <nova:memory>512</nova:memory>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:disk>1</nova:disk>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:swap>0</nova:swap>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:vcpus>1</nova:vcpus>
Nov 28 18:45:59 user nova-compute[75203]:   </nova:flavor>
Nov 28 18:45:59 user nova-compute[75203]:   <nova:owner>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:45:59 user nova-compute[75203]:   </nova:owner>
Nov 28 18:45:59 user nova-compute[75203]:   <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:45:59 user nova-compute[75203]:   <nova:ports>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:45:59 user nova-compute[75203]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:45:59 user nova-compute[75203]:     </nova:port>
Nov 28 18:45:59 user nova-compute[75203]:     <nova:port uuid="affb0e49-4f17-4c2f-bc13-ac14942a1f0e">
Nov 28 18:45:59 user nova-compute[75203]:       <nova:ip type="fixed" address="10.10.10.142" ipVersion="4"/>
Nov 28 18:45:59 user nova-compute[75203]:     </nova:port>
Nov 28 18:45:59 user nova-compute[75203]:   </nova:ports>
Nov 28 18:45:59 user nova-compute[75203]: </nova:instance>
Nov 28 18:45:59 user nova-compute[75203]:   </metadata>
Nov 28 18:45:59 user nova-compute[75203]:   <memory unit='KiB'>524288</memory>
Nov 28 18:45:59 user nova-compute[75203]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 18:45:59 user nova-compute[75203]:   <vcpu placement='static'>1</vcpu>
Nov 28 18:45:59 user nova-compute[75203]:   <resource>
Nov 28 18:45:59 user nova-compute[75203]:     <partition>/machine</partition>
Nov 28 18:45:59 user nova-compute[75203]:   </resource>
Nov 28 18:45:59 user nova-compute[75203]:   <sysinfo type='smbios'>
Nov 28 18:45:59 user nova-compute[75203]:     <system>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name='version'>0.0.0</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name='serial'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name='uuid'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:45:59 user nova-compute[75203]:       <entry name='family'>Virtual Machine</entry>
Nov 28 18:45:59 user nova-compute[75203]:     </system>
Nov 28 18:45:59 user nova-compute[75203]:   </sysinfo>
Nov 28 18:45:59 user nova-compute[75203]:   <os>
Nov 28 18:45:59 user nova-compute[75203]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 18:45:59 user nova-compute[75203]:     <boot dev='hd'/>
Nov 28 18:45:59 user nova-compute[75203]:     <smbios mode='sysinfo'/>
Nov 28 18:45:59 user nova-compute[75203]:   </os>
Nov 28 18:45:59 user nova-compute[75203]:   <features>
Nov 28 18:45:59 user nova-compute[75203]:     <acpi/>
Nov 28 18:45:59 user nova-compute[75203]:     <apic/>
Nov 28 18:45:59 user nova-compute[75203]:     <vmcoreinfo state='on'/>
Nov 28 18:45:59 user nova-compute[75203]:   </features>
Nov 28 18:45:59 user nova-compute[75203]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 18:45:59 user nova-compute[75203]:     <model fallback='forbid'>Nehalem</model>
Nov 28 18:45:59 user nova-compute[75203]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 18:45:59 user nova-compute[75203]:     <feature policy='require' name='vme'/>
Nov 28 18:45:59 user nova-compute[75203]:     <feature policy='require' name='x2apic'/>
Nov 28 18:45:59 user nova-compute[75203]:     <feature policy='require' name='hypervisor'/>
Nov 28 18:45:59 user nova-compute[75203]:   </cpu>
Nov 28 18:45:59 user nova-compute[75203]:   <clock offset='utc'>
Nov 28 18:45:59 user nova-compute[75203]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 18:45:59 user nova-compute[75203]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 18:45:59 user nova-compute[75203]:     <timer name='hpet' present='no'/>
Nov 28 18:45:59 user nova-compute[75203]:   </clock>
Nov 28 18:45:59 user nova-compute[75203]:   <on_poweroff>destroy</on_poweroff>
Nov 28 18:45:59 user nova-compute[75203]:   <on_reboot>restart</on_reboot>
Nov 28 18:45:59 user nova-compute[75203]:   <on_crash>destroy</on_crash>
Nov 28 18:45:59 user nova-compute[75203]:   <devices>
Nov 28 18:45:59 user nova-compute[75203]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 18:45:59 user nova-compute[75203]:     <disk type='file' device='disk'>
Nov 28 18:45:59 user nova-compute[75203]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 18:45:59 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk' index='2'/>
Nov 28 18:45:59 user nova-compute[75203]:       <backingStore type='file' index='3'>
Nov 28 18:45:59 user nova-compute[75203]:         <format type='raw'/>
Nov 28 18:45:59 user nova-compute[75203]:         <source file='/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b'/>
Nov 28 18:45:59 user nova-compute[75203]:         <backingStore/>
Nov 28 18:45:59 user nova-compute[75203]:       </backingStore>
Nov 28 18:45:59 user nova-compute[75203]:       <target dev='vda' bus='virtio'/>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='virtio-disk0'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </disk>
Nov 28 18:45:59 user nova-compute[75203]:     <disk type='file' device='cdrom'>
Nov 28 18:45:59 user nova-compute[75203]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 18:45:59 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config' index='1'/>
Nov 28 18:45:59 user nova-compute[75203]:       <backingStore/>
Nov 28 18:45:59 user nova-compute[75203]:       <target dev='hda' bus='ide'/>
Nov 28 18:45:59 user nova-compute[75203]:       <readonly/>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='ide0-0-0'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </disk>
Nov 28 18:45:59 user nova-compute[75203]:     <controller type='usb' index='0' model='none'>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='usb'/>
Nov 28 18:45:59 user nova-compute[75203]:     </controller>
Nov 28 18:45:59 user nova-compute[75203]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='pci.0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </controller>
Nov 28 18:45:59 user nova-compute[75203]:     <controller type='ide' index='0'>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='ide'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 18:45:59 user nova-compute[75203]:     </controller>
Nov 28 18:45:59 user nova-compute[75203]:     <interface type='ethernet'>
Nov 28 18:45:59 user nova-compute[75203]:       <mac address='fa:16:3e:19:2b:8d'/>
Nov 28 18:45:59 user nova-compute[75203]:       <target dev='tapaa825c53-e6'/>
Nov 28 18:45:59 user nova-compute[75203]:       <model type='virtio'/>
Nov 28 18:45:59 user nova-compute[75203]:       <mtu size='1442'/>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='net0'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </interface>
Nov 28 18:45:59 user nova-compute[75203]:     <interface type='ethernet'>
Nov 28 18:45:59 user nova-compute[75203]:       <mac address='fa:16:3e:c1:81:29'/>
Nov 28 18:45:59 user nova-compute[75203]:       <target dev='tapaffb0e49-4f'/>
Nov 28 18:45:59 user nova-compute[75203]:       <model type='virtio'/>
Nov 28 18:45:59 user nova-compute[75203]:       <mtu size='1442'/>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='net1'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </interface>
Nov 28 18:45:59 user nova-compute[75203]:     <serial type='pty'>
Nov 28 18:45:59 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:45:59 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:45:59 user nova-compute[75203]:       <target type='isa-serial' port='0'>
Nov 28 18:45:59 user nova-compute[75203]:         <model name='isa-serial'/>
Nov 28 18:45:59 user nova-compute[75203]:       </target>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </serial>
Nov 28 18:45:59 user nova-compute[75203]:     <console type='pty' tty='/dev/pts/10'>
Nov 28 18:45:59 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:45:59 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:45:59 user nova-compute[75203]:       <target type='serial' port='0'/>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </console>
Nov 28 18:45:59 user nova-compute[75203]:     <input type='mouse' bus='ps2'>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='input0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </input>
Nov 28 18:45:59 user nova-compute[75203]:     <input type='keyboard' bus='ps2'>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='input1'/>
Nov 28 18:45:59 user nova-compute[75203]:     </input>
Nov 28 18:45:59 user nova-compute[75203]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 28 18:45:59 user nova-compute[75203]:       <listen type='address' address='0.0.0.0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </graphics>
Nov 28 18:45:59 user nova-compute[75203]:     <audio id='1' type='none'/>
Nov 28 18:45:59 user nova-compute[75203]:     <video>
Nov 28 18:45:59 user nova-compute[75203]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='video0'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </video>
Nov 28 18:45:59 user nova-compute[75203]:     <memballoon model='virtio'>
Nov 28 18:45:59 user nova-compute[75203]:       <stats period='10'/>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='balloon0'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </memballoon>
Nov 28 18:45:59 user nova-compute[75203]:     <rng model='virtio'>
Nov 28 18:45:59 user nova-compute[75203]:       <backend model='random'>/dev/urandom</backend>
Nov 28 18:45:59 user nova-compute[75203]:       <alias name='rng0'/>
Nov 28 18:45:59 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 18:45:59 user nova-compute[75203]:     </rng>
Nov 28 18:45:59 user nova-compute[75203]:   </devices>
Nov 28 18:45:59 user nova-compute[75203]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 18:45:59 user nova-compute[75203]:     <label>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</label>
Nov 28 18:45:59 user nova-compute[75203]:     <imagelabel>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</imagelabel>
Nov 28 18:45:59 user nova-compute[75203]:   </seclabel>
Nov 28 18:45:59 user nova-compute[75203]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 18:45:59 user nova-compute[75203]:     <label>+64055:+108</label>
Nov 28 18:45:59 user nova-compute[75203]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 18:45:59 user nova-compute[75203]:   </seclabel>
Nov 28 18:45:59 user nova-compute[75203]: </domain>
Nov 28 18:45:59 user nova-compute[75203]:  {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 18:45:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully detached device tapaffb0e49-4f from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the persistent domain config.
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] (1/8): Attempting to detach device tapaffb0e49-4f with device alias net1 from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] detach device xml: <interface type="ethernet">
Nov 28 18:45:59 user nova-compute[75203]:   <mac address="fa:16:3e:c1:81:29"/>
Nov 28 18:45:59 user nova-compute[75203]:   <model type="virtio"/>
Nov 28 18:45:59 user nova-compute[75203]:   <mtu size="1442"/>
Nov 28 18:45:59 user nova-compute[75203]:   <target dev="tapaffb0e49-4f"/>
Nov 28 18:45:59 user nova-compute[75203]: </interface>
Nov 28 18:45:59 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.neutron [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updated VIF entry in instance network info cache for port cc046f13-0661-4704-b2ba-6b22fc72c2b3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG nova.network.neutron [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7b42b99e-c3ae-4a18-acb5-1aa34ebde4a8 req-8e35e1c1-ee9b-4be0-8b64-3d22228e23ea service nova] Releasing lock "refresh_cache-23ad8585-7fca-4c5b-b0d7-1258eb331c39" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.part /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.converted" returned: 0 in 0.422s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:45:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Start waiting for the detach event from libvirt for device tapaffb0e49-4f with device alias net1 for instance 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.683s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-c067339d-44a8-407b-b8ae-2571720ca9bd req-b2289773-a8ba-4cff-b455-18dbca7a1c04 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-unplugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c067339d-44a8-407b-b8ae-2571720ca9bd req-b2289773-a8ba-4cff-b455-18dbca7a1c04 service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c067339d-44a8-407b-b8ae-2571720ca9bd req-b2289773-a8ba-4cff-b455-18dbca7a1c04 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c067339d-44a8-407b-b8ae-2571720ca9bd req-b2289773-a8ba-4cff-b455-18dbca7a1c04 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-c067339d-44a8-407b-b8ae-2571720ca9bd req-b2289773-a8ba-4cff-b455-18dbca7a1c04 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-unplugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:00 user nova-compute[75203]: WARNING nova.compute.manager [req-c067339d-44a8-407b-b8ae-2571720ca9bd req-b2289773-a8ba-4cff-b455-18dbca7a1c04 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received unexpected event network-vif-unplugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e for instance with vm_state active and task_state None.
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9,backing_fmt=raw /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9,backing_fmt=raw /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk 1073741824" returned: 0 in 0.054s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'migration_context' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG nova.objects.base [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<23ad8585-7fca-4c5b-b0d7-1258eb331c39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Rebasing disk image.
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b -F raw /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-f6fa0623-79ed-412d-9b94-69f3cb7c6dc6 req-93c43253-10df-41f8-b9db-50cd435de470 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f6fa0623-79ed-412d-9b94-69f3cb7c6dc6 req-93c43253-10df-41f8-b9db-50cd435de470 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f6fa0623-79ed-412d-9b94-69f3cb7c6dc6 req-93c43253-10df-41f8-b9db-50cd435de470 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f6fa0623-79ed-412d-9b94-69f3cb7c6dc6 req-93c43253-10df-41f8-b9db-50cd435de470 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-f6fa0623-79ed-412d-9b94-69f3cb7c6dc6 req-93c43253-10df-41f8-b9db-50cd435de470 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:01 user nova-compute[75203]: WARNING nova.compute.manager [req-f6fa0623-79ed-412d-9b94-69f3cb7c6dc6 req-93c43253-10df-41f8-b9db-50cd435de470 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:46:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5799c93-6fdd-4b02-a06e-c4cdc5f06c0f req-8d66d29a-f5af-4b9f-8c29-5c9c1112fa2b service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5799c93-6fdd-4b02-a06e-c4cdc5f06c0f req-8d66d29a-f5af-4b9f-8c29-5c9c1112fa2b service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5799c93-6fdd-4b02-a06e-c4cdc5f06c0f req-8d66d29a-f5af-4b9f-8c29-5c9c1112fa2b service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5799c93-6fdd-4b02-a06e-c4cdc5f06c0f req-8d66d29a-f5af-4b9f-8c29-5c9c1112fa2b service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5799c93-6fdd-4b02-a06e-c4cdc5f06c0f req-8d66d29a-f5af-4b9f-8c29-5c9c1112fa2b service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:02 user nova-compute[75203]: WARNING nova.compute.manager [req-f5799c93-6fdd-4b02-a06e-c4cdc5f06c0f req-8d66d29a-f5af-4b9f-8c29-5c9c1112fa2b service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received unexpected event network-vif-plugged-affb0e49-4f17-4c2f-bc13-ac14942a1f0e for instance with vm_state active and task_state None.
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-30826e82-d833-4392-9a69-b607c11c48af req-25fdfa0e-dec6-4808-ba94-aeaa177e2fe6 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-30826e82-d833-4392-9a69-b607c11c48af req-25fdfa0e-dec6-4808-ba94-aeaa177e2fe6 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-30826e82-d833-4392-9a69-b607c11c48af req-25fdfa0e-dec6-4808-ba94-aeaa177e2fe6 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-30826e82-d833-4392-9a69-b607c11c48af req-25fdfa0e-dec6-4808-ba94-aeaa177e2fe6 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-30826e82-d833-4392-9a69-b607c11c48af req-25fdfa0e-dec6-4808-ba94-aeaa177e2fe6 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:03 user nova-compute[75203]: WARNING nova.compute.manager [req-30826e82-d833-4392-9a69-b607c11c48af req-25fdfa0e-dec6-4808-ba94-aeaa177e2fe6 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state resized and task_state resize_reverting.
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:46:03 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance running successfully.
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] finish_revert_migration finished successfully. {{(pid=75203) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b -F raw /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk" returned: 0 in 2.727s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Ensure instance console log exists: /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Start _get_guest_xml network_info=[{"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2d10711de4e3d3b09dedc392bcaed96c',container_format='bare',created_at=2023-11-28T18:44:04Z,direct_url=<?>,disk_format='qcow2',id=4f75d139-9325-4be7-9df7-0dbfa739f511,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-391113207-shelved',owner='39b4d281e6da4779a68b17ecd896e6a2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T18:44:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:46:03 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:03 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2d10711de4e3d3b09dedc392bcaed96c',container_format='bare',created_at=2023-11-28T18:44:04Z,direct_url=<?>,disk_format='qcow2',id=4f75d139-9325-4be7-9df7-0dbfa739f511,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-391113207-shelved',owner='39b4d281e6da4779a68b17ecd896e6a2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-28T18:44:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.objects.instance [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.objects.base [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<23ad8585-7fca-4c5b-b0d7-1258eb331c39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391113207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391113207',id=21,image_ref='4f75d139-9325-4be7-9df7-0dbfa739f511',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-743467751',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-jmyn900h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member',shelved_at='2023-11-28T18:44:08.346108',shelved_host='user',shelved_image_id='4f75d139-9325-4be7-9df7-0dbfa739f511'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=23ad8585-7fca-4c5b-b0d7-1258eb331c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.objects.instance [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'pci_devices' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.objects.base [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Object Instance<23ad8585-7fca-4c5b-b0d7-1258eb331c39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:46:03 user nova-compute[75203]:   <uuid>23ad8585-7fca-4c5b-b0d7-1258eb331c39</uuid>
Nov 28 18:46:03 user nova-compute[75203]:   <name>instance-00000015</name>
Nov 28 18:46:03 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:46:03 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:46:03 user nova-compute[75203]:   <metadata>
Nov 28 18:46:03 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:03 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:46:03 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-391113207</nova:name>
Nov 28 18:46:03 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:46:03</nova:creationTime>
Nov 28 18:46:03 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:46:03 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:46:03 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:46:03 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:46:03 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:03 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:03 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:46:03 user nova-compute[75203]:       <nova:owner>
Nov 28 18:46:03 user nova-compute[75203]:         <nova:user uuid="c1a7cdac05464b9ca3ef185aafe6ea0d">tempest-AttachVolumeShelveTestJSON-1995055501-project-member</nova:user>
Nov 28 18:46:03 user nova-compute[75203]:         <nova:project uuid="39b4d281e6da4779a68b17ecd896e6a2">tempest-AttachVolumeShelveTestJSON-1995055501</nova:project>
Nov 28 18:46:03 user nova-compute[75203]:       </nova:owner>
Nov 28 18:46:03 user nova-compute[75203]:       <nova:root type="image" uuid="4f75d139-9325-4be7-9df7-0dbfa739f511"/>
Nov 28 18:46:03 user nova-compute[75203]:       <nova:ports>
Nov 28 18:46:03 user nova-compute[75203]:         <nova:port uuid="cc046f13-0661-4704-b2ba-6b22fc72c2b3">
Nov 28 18:46:03 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 18:46:03 user nova-compute[75203]:         </nova:port>
Nov 28 18:46:03 user nova-compute[75203]:       </nova:ports>
Nov 28 18:46:03 user nova-compute[75203]:     </nova:instance>
Nov 28 18:46:03 user nova-compute[75203]:   </metadata>
Nov 28 18:46:03 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:46:03 user nova-compute[75203]:     <system>
Nov 28 18:46:03 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:46:03 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:46:03 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:46:03 user nova-compute[75203]:       <entry name="serial">23ad8585-7fca-4c5b-b0d7-1258eb331c39</entry>
Nov 28 18:46:03 user nova-compute[75203]:       <entry name="uuid">23ad8585-7fca-4c5b-b0d7-1258eb331c39</entry>
Nov 28 18:46:03 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:46:03 user nova-compute[75203]:     </system>
Nov 28 18:46:03 user nova-compute[75203]:   </sysinfo>
Nov 28 18:46:03 user nova-compute[75203]:   <os>
Nov 28 18:46:03 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:46:03 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:46:03 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:46:03 user nova-compute[75203]:   </os>
Nov 28 18:46:03 user nova-compute[75203]:   <features>
Nov 28 18:46:03 user nova-compute[75203]:     <acpi/>
Nov 28 18:46:03 user nova-compute[75203]:     <apic/>
Nov 28 18:46:03 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:46:03 user nova-compute[75203]:   </features>
Nov 28 18:46:03 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:46:03 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:46:03 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:46:03 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:46:03 user nova-compute[75203]:   </clock>
Nov 28 18:46:03 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:46:03 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:46:03 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:46:03 user nova-compute[75203]:   </cpu>
Nov 28 18:46:03 user nova-compute[75203]:   <devices>
Nov 28 18:46:03 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:46:03 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:46:03 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk"/>
Nov 28 18:46:03 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:46:03 user nova-compute[75203]:     </disk>
Nov 28 18:46:03 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:46:03 user nova-compute[75203]:       <mac address="fa:16:3e:d5:2b:4b"/>
Nov 28 18:46:03 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:46:03 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:46:03 user nova-compute[75203]:       <target dev="tapcc046f13-06"/>
Nov 28 18:46:03 user nova-compute[75203]:     </interface>
Nov 28 18:46:03 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:46:03 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/console.log" append="off"/>
Nov 28 18:46:03 user nova-compute[75203]:     </serial>
Nov 28 18:46:03 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:46:03 user nova-compute[75203]:     <video>
Nov 28 18:46:03 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:46:03 user nova-compute[75203]:     </video>
Nov 28 18:46:03 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:46:03 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:46:03 user nova-compute[75203]:     </rng>
Nov 28 18:46:03 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:46:03 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:46:03 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:46:03 user nova-compute[75203]:     </memballoon>
Nov 28 18:46:03 user nova-compute[75203]:   </devices>
Nov 28 18:46:03 user nova-compute[75203]: </domain>
Nov 28 18:46:03 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391113207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391113207',id=21,image_ref='4f75d139-9325-4be7-9df7-0dbfa739f511',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-743467751',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-jmyn900h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member',shelved_at='2023-11-28T18:44:08.346108',shelved_host='user',shelved_image_id='4f75d139-9325-4be7-9df7-0dbfa739f511'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:45:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=23ad8585-7fca-4c5b-b0d7-1258eb331c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG os_vif [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b8c8229-60ef-5f69-914c-733270f1538e', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc046f13-06, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc046f13-06, col_values=(('qos', UUID('b9216be0-63f3-4ee7-a03b-0b6e7048767a')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc046f13-06, col_values=(('external_ids', {'iface-id': 'cc046f13-0661-4704-b2ba-6b22fc72c2b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:2b:4b', 'vm-uuid': '23ad8585-7fca-4c5b-b0d7-1258eb331c39'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:03 user nova-compute[75203]: INFO os_vif [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06')
Nov 28 18:46:03 user nova-compute[75203]: INFO nova.compute.manager [None req-ef87a0c2-d972-4ac5-a38b-78597e8f1e53 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance to original state: 'active'
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:46:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] No VIF found with MAC fa:16:3e:d5:2b:4b, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-ca30ae34-fb2b-44e1-a040-db956b49b3e6 req-9cbff90c-c644-45ce-830a-0c5525adbb79 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ca30ae34-fb2b-44e1-a040-db956b49b3e6 req-9cbff90c-c644-45ce-830a-0c5525adbb79 service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ca30ae34-fb2b-44e1-a040-db956b49b3e6 req-9cbff90c-c644-45ce-830a-0c5525adbb79 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ca30ae34-fb2b-44e1-a040-db956b49b3e6 req-9cbff90c-c644-45ce-830a-0c5525adbb79 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-ca30ae34-fb2b-44e1-a040-db956b49b3e6 req-9cbff90c-c644-45ce-830a-0c5525adbb79 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:05 user nova-compute[75203]: WARNING nova.compute.manager [req-ca30ae34-fb2b-44e1-a040-db956b49b3e6 req-9cbff90c-c644-45ce-830a-0c5525adbb79 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received unexpected event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 18:46:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-66078725-6a10-4bf3-a394-5cd373aeb1ef req-4cb5fa56-eb18-44dc-b98a-4cb2a3dcc928 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-66078725-6a10-4bf3-a394-5cd373aeb1ef req-4cb5fa56-eb18-44dc-b98a-4cb2a3dcc928 service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-66078725-6a10-4bf3-a394-5cd373aeb1ef req-4cb5fa56-eb18-44dc-b98a-4cb2a3dcc928 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-66078725-6a10-4bf3-a394-5cd373aeb1ef req-4cb5fa56-eb18-44dc-b98a-4cb2a3dcc928 service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-66078725-6a10-4bf3-a394-5cd373aeb1ef req-4cb5fa56-eb18-44dc-b98a-4cb2a3dcc928 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:07 user nova-compute[75203]: WARNING nova.compute.manager [req-66078725-6a10-4bf3-a394-5cd373aeb1ef req-4cb5fa56-eb18-44dc-b98a-4cb2a3dcc928 service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received unexpected event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 18:46:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:46:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:46:07 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance spawned successfully.
Nov 28 18:46:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:46:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-93259568-faac-40ed-a3c4-a710ff21c99a tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.079s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:12 user nova-compute[75203]: INFO nova.compute.manager [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attaching volume de1b1094-fd91-4aa4-aab0-f36e15d4067e to /dev/vdb
Nov 28 18:46:12 user nova-compute[75203]: DEBUG os_brick.utils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7befcdf5-ed1c-41c2-99cf-709fcf969cc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3afc24-eebf-47d9-ba67-68b2d84ac48c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b0997-6733-4f3d-95f6-43d94e27141b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[04547fec-b784-4186-abf9-c9bab5166064]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:46:13 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:46:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e0160d-1f8d-49c5-ab73-1d6b251662af]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG os_brick.utils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating existing volume attachment record: 06e368d1-5598-4261-916a-16f67a9af4b9 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNzVaoxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:46:20 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:46:20 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:46:20 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:20 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Waiting for libvirt event about the detach of device tapaffb0e49-4f with device alias net1 from instance 177bbb95-7d1b-4c19-b3fd-182653317455 is timed out.
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface> {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:46:20 user nova-compute[75203]: INFO nova.compute.claims [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Claim successful on node user
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4e103f-307d-4777-8f77-94401b877dce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 28 18:46:20 user nova-compute[75203]:   <name>instance-00000017</name>
Nov 28 18:46:20 user nova-compute[75203]:   <uuid>177bbb95-7d1b-4c19-b3fd-182653317455</uuid>
Nov 28 18:46:20 user nova-compute[75203]:   <metadata>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:20 user nova-compute[75203]:   <nova:package version="0.0.0"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:creationTime>2023-11-28 18:45:25</nova:creationTime>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:flavor name="m1.tiny">
Nov 28 18:46:20 user nova-compute[75203]:     <nova:memory>512</nova:memory>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:disk>1</nova:disk>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:swap>0</nova:swap>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:flavor>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:ports>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:46:20 user nova-compute[75203]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:46:20 user nova-compute[75203]:     </nova:port>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:port uuid="affb0e49-4f17-4c2f-bc13-ac14942a1f0e">
Nov 28 18:46:20 user nova-compute[75203]:       <nova:ip type="fixed" address="10.10.10.142" ipVersion="4"/>
Nov 28 18:46:20 user nova-compute[75203]:     </nova:port>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:ports>
Nov 28 18:46:20 user nova-compute[75203]: </nova:instance>
Nov 28 18:46:20 user nova-compute[75203]:   </metadata>
Nov 28 18:46:20 user nova-compute[75203]:   <memory unit='KiB'>524288</memory>
Nov 28 18:46:20 user nova-compute[75203]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 18:46:20 user nova-compute[75203]:   <vcpu placement='static'>1</vcpu>
Nov 28 18:46:20 user nova-compute[75203]:   <resource>
Nov 28 18:46:20 user nova-compute[75203]:     <partition>/machine</partition>
Nov 28 18:46:20 user nova-compute[75203]:   </resource>
Nov 28 18:46:20 user nova-compute[75203]:   <sysinfo type='smbios'>
Nov 28 18:46:20 user nova-compute[75203]:     <system>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='version'>0.0.0</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='serial'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='uuid'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='family'>Virtual Machine</entry>
Nov 28 18:46:20 user nova-compute[75203]:     </system>
Nov 28 18:46:20 user nova-compute[75203]:   </sysinfo>
Nov 28 18:46:20 user nova-compute[75203]:   <os>
Nov 28 18:46:20 user nova-compute[75203]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 18:46:20 user nova-compute[75203]:     <boot dev='hd'/>
Nov 28 18:46:20 user nova-compute[75203]:     <smbios mode='sysinfo'/>
Nov 28 18:46:20 user nova-compute[75203]:   </os>
Nov 28 18:46:20 user nova-compute[75203]:   <features>
Nov 28 18:46:20 user nova-compute[75203]:     <acpi/>
Nov 28 18:46:20 user nova-compute[75203]:     <apic/>
Nov 28 18:46:20 user nova-compute[75203]:     <vmcoreinfo state='on'/>
Nov 28 18:46:20 user nova-compute[75203]:   </features>
Nov 28 18:46:20 user nova-compute[75203]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 18:46:20 user nova-compute[75203]:     <model fallback='forbid'>Nehalem</model>
Nov 28 18:46:20 user nova-compute[75203]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='vme'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='x2apic'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='hypervisor'/>
Nov 28 18:46:20 user nova-compute[75203]:   </cpu>
Nov 28 18:46:20 user nova-compute[75203]:   <clock offset='utc'>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='hpet' present='no'/>
Nov 28 18:46:20 user nova-compute[75203]:   </clock>
Nov 28 18:46:20 user nova-compute[75203]:   <on_poweroff>destroy</on_poweroff>
Nov 28 18:46:20 user nova-compute[75203]:   <on_reboot>restart</on_reboot>
Nov 28 18:46:20 user nova-compute[75203]:   <on_crash>destroy</on_crash>
Nov 28 18:46:20 user nova-compute[75203]:   <devices>
Nov 28 18:46:20 user nova-compute[75203]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 18:46:20 user nova-compute[75203]:     <disk type='file' device='disk'>
Nov 28 18:46:20 user nova-compute[75203]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 18:46:20 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk' index='2'/>
Nov 28 18:46:20 user nova-compute[75203]:       <backingStore type='file' index='3'>
Nov 28 18:46:20 user nova-compute[75203]:         <format type='raw'/>
Nov 28 18:46:20 user nova-compute[75203]:         <source file='/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b'/>
Nov 28 18:46:20 user nova-compute[75203]:         <backingStore/>
Nov 28 18:46:20 user nova-compute[75203]:       </backingStore>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='vda' bus='virtio'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='virtio-disk0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </disk>
Nov 28 18:46:20 user nova-compute[75203]:     <disk type='file' device='cdrom'>
Nov 28 18:46:20 user nova-compute[75203]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 18:46:20 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config' index='1'/>
Nov 28 18:46:20 user nova-compute[75203]:       <backingStore/>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='hda' bus='ide'/>
Nov 28 18:46:20 user nova-compute[75203]:       <readonly/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='ide0-0-0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </disk>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='usb' index='0' model='none'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='usb'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='pci.0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='ide' index='0'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='ide'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <interface type='ethernet'>
Nov 28 18:46:20 user nova-compute[75203]:       <mac address='fa:16:3e:19:2b:8d'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='tapaa825c53-e6'/>
Nov 28 18:46:20 user nova-compute[75203]:       <model type='virtio'/>
Nov 28 18:46:20 user nova-compute[75203]:       <mtu size='1442'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='net0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </interface>
Nov 28 18:46:20 user nova-compute[75203]:     <serial type='pty'>
Nov 28 18:46:20 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target type='isa-serial' port='0'>
Nov 28 18:46:20 user nova-compute[75203]:         <model name='isa-serial'/>
Nov 28 18:46:20 user nova-compute[75203]:       </target>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </serial>
Nov 28 18:46:20 user nova-compute[75203]:     <console type='pty' tty='/dev/pts/10'>
Nov 28 18:46:20 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target type='serial' port='0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </console>
Nov 28 18:46:20 user nova-compute[75203]:     <input type='mouse' bus='ps2'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='input0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </input>
Nov 28 18:46:20 user nova-compute[75203]:     <input type='keyboard' bus='ps2'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='input1'/>
Nov 28 18:46:20 user nova-compute[75203]:     </input>
Nov 28 18:46:20 user nova-compute[75203]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 28 18:46:20 user nova-compute[75203]:       <listen type='address' address='0.0.0.0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </graphics>
Nov 28 18:46:20 user nova-compute[75203]:     <audio id='1' type='none'/>
Nov 28 18:46:20 user nova-compute[75203]:     <video>
Nov 28 18:46:20 user nova-compute[75203]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='video0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </video>
Nov 28 18:46:20 user nova-compute[75203]:     <memballoon model='virtio'>
Nov 28 18:46:20 user nova-compute[75203]:       <stats period='10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='balloon0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </memballoon>
Nov 28 18:46:20 user nova-compute[75203]:     <rng model='virtio'>
Nov 28 18:46:20 user nova-compute[75203]:       <backend model='random'>/dev/urandom</backend>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='rng0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </rng>
Nov 28 18:46:20 user nova-compute[75203]:   </devices>
Nov 28 18:46:20 user nova-compute[75203]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 18:46:20 user nova-compute[75203]:     <label>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</label>
Nov 28 18:46:20 user nova-compute[75203]:     <imagelabel>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</imagelabel>
Nov 28 18:46:20 user nova-compute[75203]:   </seclabel>
Nov 28 18:46:20 user nova-compute[75203]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 18:46:20 user nova-compute[75203]:     <label>+64055:+108</label>
Nov 28 18:46:20 user nova-compute[75203]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 18:46:20 user nova-compute[75203]:   </seclabel>
Nov 28 18:46:20 user nova-compute[75203]: </domain>
Nov 28 18:46:20 user nova-compute[75203]:  {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 18:46:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully detached device tapaffb0e49-4f from instance 177bbb95-7d1b-4c19-b3fd-182653317455 from the live domain config.
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converting VIF {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_vif [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:46:20 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaffb0e49-4f, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0b1bf13-93af-46fa-8954-84650a7f1d70) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af052c42-1f6d-4aee-871b-0baf5bac420e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e] added
Nov 28 18:46:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: INFO os_vif [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f')
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:20 user nova-compute[75203]:   <nova:package version="0.0.0"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:creationTime>2023-11-28 18:46:20</nova:creationTime>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:flavor name="m1.tiny">
Nov 28 18:46:20 user nova-compute[75203]:     <nova:memory>512</nova:memory>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:disk>1</nova:disk>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:swap>0</nova:swap>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:flavor>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:ports>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:46:20 user nova-compute[75203]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:46:20 user nova-compute[75203]:     </nova:port>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:ports>
Nov 28 18:46:20 user nova-compute[75203]: </nova:instance>
Nov 28 18:46:20 user nova-compute[75203]:  {{(pid=75203) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42844d8-2a5e-4838-8576-60fc829911a8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b200c47-8584-4579-944f-fce7303c4a55]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNzVaoxH {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNzVaoxH" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19ff97f-08ec-4379-876c-2448af550bf9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNzVaoxH'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5925ab-3a8e-4db1-adce-ab456429a8ff]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a845b7-a57a-457c-b891-279a6ae7395f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f5fad0-f827-4943-acbb-18f182a2cd41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260]
Nov 28 18:46:20 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260] successful.
Nov 28 18:46:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5bd246-ec66-426b-8273-b863df070cdc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d934c-c48d-4d4d-a9eb-f8037d199f93]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:20 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6646b2-dc8b-4195-919d-05ad7e0f5639]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNzVaoxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-deleted-affb0e49-4f17-4c2f-bc13-ac14942a1f0e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:20 user nova-compute[75203]: INFO nova.compute.manager [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Neutron deleted interface affb0e49-4f17-4c2f-bc13-ac14942a1f0e; detaching it from the instance and deleting it from the info cache
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.neutron [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.objects.instance [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Lazy-loading 'system_metadata' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquired lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.objects.instance [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Lazy-loading 'flavor' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.objects.base [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Object Instance<177bbb95-7d1b-4c19-b3fd-182653317455> lazy-loaded attributes: system_metadata,flavor {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Converting VIF {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface> {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 28 18:46:20 user nova-compute[75203]:   <name>instance-00000017</name>
Nov 28 18:46:20 user nova-compute[75203]:   <uuid>177bbb95-7d1b-4c19-b3fd-182653317455</uuid>
Nov 28 18:46:20 user nova-compute[75203]:   <metadata>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:20 user nova-compute[75203]:   <nova:package version="0.0.0"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:creationTime>2023-11-28 18:46:20</nova:creationTime>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:flavor name="m1.tiny">
Nov 28 18:46:20 user nova-compute[75203]:     <nova:memory>512</nova:memory>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:disk>1</nova:disk>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:swap>0</nova:swap>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:flavor>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:ports>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:46:20 user nova-compute[75203]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:46:20 user nova-compute[75203]:     </nova:port>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:ports>
Nov 28 18:46:20 user nova-compute[75203]: </nova:instance>
Nov 28 18:46:20 user nova-compute[75203]:   </metadata>
Nov 28 18:46:20 user nova-compute[75203]:   <memory unit='KiB'>524288</memory>
Nov 28 18:46:20 user nova-compute[75203]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 18:46:20 user nova-compute[75203]:   <vcpu placement='static'>1</vcpu>
Nov 28 18:46:20 user nova-compute[75203]:   <resource>
Nov 28 18:46:20 user nova-compute[75203]:     <partition>/machine</partition>
Nov 28 18:46:20 user nova-compute[75203]:   </resource>
Nov 28 18:46:20 user nova-compute[75203]:   <sysinfo type='smbios'>
Nov 28 18:46:20 user nova-compute[75203]:     <system>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='version'>0.0.0</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='serial'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='uuid'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='family'>Virtual Machine</entry>
Nov 28 18:46:20 user nova-compute[75203]:     </system>
Nov 28 18:46:20 user nova-compute[75203]:   </sysinfo>
Nov 28 18:46:20 user nova-compute[75203]:   <os>
Nov 28 18:46:20 user nova-compute[75203]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 18:46:20 user nova-compute[75203]:     <boot dev='hd'/>
Nov 28 18:46:20 user nova-compute[75203]:     <smbios mode='sysinfo'/>
Nov 28 18:46:20 user nova-compute[75203]:   </os>
Nov 28 18:46:20 user nova-compute[75203]:   <features>
Nov 28 18:46:20 user nova-compute[75203]:     <acpi/>
Nov 28 18:46:20 user nova-compute[75203]:     <apic/>
Nov 28 18:46:20 user nova-compute[75203]:     <vmcoreinfo state='on'/>
Nov 28 18:46:20 user nova-compute[75203]:   </features>
Nov 28 18:46:20 user nova-compute[75203]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 18:46:20 user nova-compute[75203]:     <model fallback='forbid'>Nehalem</model>
Nov 28 18:46:20 user nova-compute[75203]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='vme'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='x2apic'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='hypervisor'/>
Nov 28 18:46:20 user nova-compute[75203]:   </cpu>
Nov 28 18:46:20 user nova-compute[75203]:   <clock offset='utc'>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='hpet' present='no'/>
Nov 28 18:46:20 user nova-compute[75203]:   </clock>
Nov 28 18:46:20 user nova-compute[75203]:   <on_poweroff>destroy</on_poweroff>
Nov 28 18:46:20 user nova-compute[75203]:   <on_reboot>restart</on_reboot>
Nov 28 18:46:20 user nova-compute[75203]:   <on_crash>destroy</on_crash>
Nov 28 18:46:20 user nova-compute[75203]:   <devices>
Nov 28 18:46:20 user nova-compute[75203]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 18:46:20 user nova-compute[75203]:     <disk type='file' device='disk'>
Nov 28 18:46:20 user nova-compute[75203]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 18:46:20 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk' index='2'/>
Nov 28 18:46:20 user nova-compute[75203]:       <backingStore type='file' index='3'>
Nov 28 18:46:20 user nova-compute[75203]:         <format type='raw'/>
Nov 28 18:46:20 user nova-compute[75203]:         <source file='/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b'/>
Nov 28 18:46:20 user nova-compute[75203]:         <backingStore/>
Nov 28 18:46:20 user nova-compute[75203]:       </backingStore>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='vda' bus='virtio'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='virtio-disk0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </disk>
Nov 28 18:46:20 user nova-compute[75203]:     <disk type='file' device='cdrom'>
Nov 28 18:46:20 user nova-compute[75203]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 18:46:20 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config' index='1'/>
Nov 28 18:46:20 user nova-compute[75203]:       <backingStore/>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='hda' bus='ide'/>
Nov 28 18:46:20 user nova-compute[75203]:       <readonly/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='ide0-0-0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </disk>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='usb' index='0' model='none'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='usb'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='pci.0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='ide' index='0'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='ide'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <interface type='ethernet'>
Nov 28 18:46:20 user nova-compute[75203]:       <mac address='fa:16:3e:19:2b:8d'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='tapaa825c53-e6'/>
Nov 28 18:46:20 user nova-compute[75203]:       <model type='virtio'/>
Nov 28 18:46:20 user nova-compute[75203]:       <mtu size='1442'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='net0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </interface>
Nov 28 18:46:20 user nova-compute[75203]:     <serial type='pty'>
Nov 28 18:46:20 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target type='isa-serial' port='0'>
Nov 28 18:46:20 user nova-compute[75203]:         <model name='isa-serial'/>
Nov 28 18:46:20 user nova-compute[75203]:       </target>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </serial>
Nov 28 18:46:20 user nova-compute[75203]:     <console type='pty' tty='/dev/pts/10'>
Nov 28 18:46:20 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target type='serial' port='0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </console>
Nov 28 18:46:20 user nova-compute[75203]:     <input type='mouse' bus='ps2'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='input0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </input>
Nov 28 18:46:20 user nova-compute[75203]:     <input type='keyboard' bus='ps2'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='input1'/>
Nov 28 18:46:20 user nova-compute[75203]:     </input>
Nov 28 18:46:20 user nova-compute[75203]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 28 18:46:20 user nova-compute[75203]:       <listen type='address' address='0.0.0.0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </graphics>
Nov 28 18:46:20 user nova-compute[75203]:     <audio id='1' type='none'/>
Nov 28 18:46:20 user nova-compute[75203]:     <video>
Nov 28 18:46:20 user nova-compute[75203]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='video0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </video>
Nov 28 18:46:20 user nova-compute[75203]:     <memballoon model='virtio'>
Nov 28 18:46:20 user nova-compute[75203]:       <stats period='10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='balloon0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </memballoon>
Nov 28 18:46:20 user nova-compute[75203]:     <rng model='virtio'>
Nov 28 18:46:20 user nova-compute[75203]:       <backend model='random'>/dev/urandom</backend>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='rng0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </rng>
Nov 28 18:46:20 user nova-compute[75203]:   </devices>
Nov 28 18:46:20 user nova-compute[75203]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 18:46:20 user nova-compute[75203]:     <label>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</label>
Nov 28 18:46:20 user nova-compute[75203]:     <imagelabel>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</imagelabel>
Nov 28 18:46:20 user nova-compute[75203]:   </seclabel>
Nov 28 18:46:20 user nova-compute[75203]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 18:46:20 user nova-compute[75203]:     <label>+64055:+108</label>
Nov 28 18:46:20 user nova-compute[75203]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 18:46:20 user nova-compute[75203]:   </seclabel>
Nov 28 18:46:20 user nova-compute[75203]: </domain>
Nov 28 18:46:20 user nova-compute[75203]:  {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface> {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c1:81:29"/><model type="virtio"/><mtu size="1442"/><target dev="tapaffb0e49-4f"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 28 18:46:20 user nova-compute[75203]:   <name>instance-00000017</name>
Nov 28 18:46:20 user nova-compute[75203]:   <uuid>177bbb95-7d1b-4c19-b3fd-182653317455</uuid>
Nov 28 18:46:20 user nova-compute[75203]:   <metadata>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:20 user nova-compute[75203]:   <nova:package version="0.0.0"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:creationTime>2023-11-28 18:46:20</nova:creationTime>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:flavor name="m1.tiny">
Nov 28 18:46:20 user nova-compute[75203]:     <nova:memory>512</nova:memory>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:disk>1</nova:disk>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:swap>0</nova:swap>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:flavor>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:ports>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:46:20 user nova-compute[75203]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:46:20 user nova-compute[75203]:     </nova:port>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:ports>
Nov 28 18:46:20 user nova-compute[75203]: </nova:instance>
Nov 28 18:46:20 user nova-compute[75203]:   </metadata>
Nov 28 18:46:20 user nova-compute[75203]:   <memory unit='KiB'>524288</memory>
Nov 28 18:46:20 user nova-compute[75203]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 28 18:46:20 user nova-compute[75203]:   <vcpu placement='static'>1</vcpu>
Nov 28 18:46:20 user nova-compute[75203]:   <resource>
Nov 28 18:46:20 user nova-compute[75203]:     <partition>/machine</partition>
Nov 28 18:46:20 user nova-compute[75203]:   </resource>
Nov 28 18:46:20 user nova-compute[75203]:   <sysinfo type='smbios'>
Nov 28 18:46:20 user nova-compute[75203]:     <system>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='product'>OpenStack Nova</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='version'>0.0.0</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='serial'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='uuid'>177bbb95-7d1b-4c19-b3fd-182653317455</entry>
Nov 28 18:46:20 user nova-compute[75203]:       <entry name='family'>Virtual Machine</entry>
Nov 28 18:46:20 user nova-compute[75203]:     </system>
Nov 28 18:46:20 user nova-compute[75203]:   </sysinfo>
Nov 28 18:46:20 user nova-compute[75203]:   <os>
Nov 28 18:46:20 user nova-compute[75203]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 28 18:46:20 user nova-compute[75203]:     <boot dev='hd'/>
Nov 28 18:46:20 user nova-compute[75203]:     <smbios mode='sysinfo'/>
Nov 28 18:46:20 user nova-compute[75203]:   </os>
Nov 28 18:46:20 user nova-compute[75203]:   <features>
Nov 28 18:46:20 user nova-compute[75203]:     <acpi/>
Nov 28 18:46:20 user nova-compute[75203]:     <apic/>
Nov 28 18:46:20 user nova-compute[75203]:     <vmcoreinfo state='on'/>
Nov 28 18:46:20 user nova-compute[75203]:   </features>
Nov 28 18:46:20 user nova-compute[75203]:   <cpu mode='custom' match='exact' check='full'>
Nov 28 18:46:20 user nova-compute[75203]:     <model fallback='forbid'>Nehalem</model>
Nov 28 18:46:20 user nova-compute[75203]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='vme'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='x2apic'/>
Nov 28 18:46:20 user nova-compute[75203]:     <feature policy='require' name='hypervisor'/>
Nov 28 18:46:20 user nova-compute[75203]:   </cpu>
Nov 28 18:46:20 user nova-compute[75203]:   <clock offset='utc'>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='pit' tickpolicy='delay'/>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 28 18:46:20 user nova-compute[75203]:     <timer name='hpet' present='no'/>
Nov 28 18:46:20 user nova-compute[75203]:   </clock>
Nov 28 18:46:20 user nova-compute[75203]:   <on_poweroff>destroy</on_poweroff>
Nov 28 18:46:20 user nova-compute[75203]:   <on_reboot>restart</on_reboot>
Nov 28 18:46:20 user nova-compute[75203]:   <on_crash>destroy</on_crash>
Nov 28 18:46:20 user nova-compute[75203]:   <devices>
Nov 28 18:46:20 user nova-compute[75203]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 28 18:46:20 user nova-compute[75203]:     <disk type='file' device='disk'>
Nov 28 18:46:20 user nova-compute[75203]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 28 18:46:20 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk' index='2'/>
Nov 28 18:46:20 user nova-compute[75203]:       <backingStore type='file' index='3'>
Nov 28 18:46:20 user nova-compute[75203]:         <format type='raw'/>
Nov 28 18:46:20 user nova-compute[75203]:         <source file='/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b'/>
Nov 28 18:46:20 user nova-compute[75203]:         <backingStore/>
Nov 28 18:46:20 user nova-compute[75203]:       </backingStore>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='vda' bus='virtio'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='virtio-disk0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </disk>
Nov 28 18:46:20 user nova-compute[75203]:     <disk type='file' device='cdrom'>
Nov 28 18:46:20 user nova-compute[75203]:       <driver name='qemu' type='raw' cache='none'/>
Nov 28 18:46:20 user nova-compute[75203]:       <source file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/disk.config' index='1'/>
Nov 28 18:46:20 user nova-compute[75203]:       <backingStore/>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='hda' bus='ide'/>
Nov 28 18:46:20 user nova-compute[75203]:       <readonly/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='ide0-0-0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </disk>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='usb' index='0' model='none'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='usb'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='pci' index='0' model='pci-root'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='pci.0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <controller type='ide' index='0'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='ide'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 28 18:46:20 user nova-compute[75203]:     </controller>
Nov 28 18:46:20 user nova-compute[75203]:     <interface type='ethernet'>
Nov 28 18:46:20 user nova-compute[75203]:       <mac address='fa:16:3e:19:2b:8d'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target dev='tapaa825c53-e6'/>
Nov 28 18:46:20 user nova-compute[75203]:       <model type='virtio'/>
Nov 28 18:46:20 user nova-compute[75203]:       <mtu size='1442'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='net0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </interface>
Nov 28 18:46:20 user nova-compute[75203]:     <serial type='pty'>
Nov 28 18:46:20 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target type='isa-serial' port='0'>
Nov 28 18:46:20 user nova-compute[75203]:         <model name='isa-serial'/>
Nov 28 18:46:20 user nova-compute[75203]:       </target>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </serial>
Nov 28 18:46:20 user nova-compute[75203]:     <console type='pty' tty='/dev/pts/10'>
Nov 28 18:46:20 user nova-compute[75203]:       <source path='/dev/pts/10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <log file='/opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455/console.log' append='off'/>
Nov 28 18:46:20 user nova-compute[75203]:       <target type='serial' port='0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='serial0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </console>
Nov 28 18:46:20 user nova-compute[75203]:     <input type='mouse' bus='ps2'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='input0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </input>
Nov 28 18:46:20 user nova-compute[75203]:     <input type='keyboard' bus='ps2'>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='input1'/>
Nov 28 18:46:20 user nova-compute[75203]:     </input>
Nov 28 18:46:20 user nova-compute[75203]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Nov 28 18:46:20 user nova-compute[75203]:       <listen type='address' address='0.0.0.0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </graphics>
Nov 28 18:46:20 user nova-compute[75203]:     <audio id='1' type='none'/>
Nov 28 18:46:20 user nova-compute[75203]:     <video>
Nov 28 18:46:20 user nova-compute[75203]:       <model type='virtio' heads='1' primary='yes'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='video0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </video>
Nov 28 18:46:20 user nova-compute[75203]:     <memballoon model='virtio'>
Nov 28 18:46:20 user nova-compute[75203]:       <stats period='10'/>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='balloon0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </memballoon>
Nov 28 18:46:20 user nova-compute[75203]:     <rng model='virtio'>
Nov 28 18:46:20 user nova-compute[75203]:       <backend model='random'>/dev/urandom</backend>
Nov 28 18:46:20 user nova-compute[75203]:       <alias name='rng0'/>
Nov 28 18:46:20 user nova-compute[75203]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 28 18:46:20 user nova-compute[75203]:     </rng>
Nov 28 18:46:20 user nova-compute[75203]:   </devices>
Nov 28 18:46:20 user nova-compute[75203]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 28 18:46:20 user nova-compute[75203]:     <label>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</label>
Nov 28 18:46:20 user nova-compute[75203]:     <imagelabel>libvirt-177bbb95-7d1b-4c19-b3fd-182653317455</imagelabel>
Nov 28 18:46:20 user nova-compute[75203]:   </seclabel>
Nov 28 18:46:20 user nova-compute[75203]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 28 18:46:20 user nova-compute[75203]:     <label>+64055:+108</label>
Nov 28 18:46:20 user nova-compute[75203]:     <imagelabel>+64055:+108</imagelabel>
Nov 28 18:46:20 user nova-compute[75203]:   </seclabel>
Nov 28 18:46:20 user nova-compute[75203]: </domain>
Nov 28 18:46:20 user nova-compute[75203]:  {{(pid=75203) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 28 18:46:20 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Detaching interface fa:16:3e:c1:81:29 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapaffb0e49-4f' not found.
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Converting VIF {"id": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "address": "fa:16:3e:c1:81:29", "network": {"id": "fc87f44f-12b8-4ddf-b483-edf372bad0b4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465958298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaffb0e49-4f", "ovs_interfaceid": "affb0e49-4f17-4c2f-bc13-ac14942a1f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.network.os_vif_util [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_vif [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:46:20 user nova-compute[75203]: INFO nova.virt.block_device [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Booting with volume 9b67fbfb-6046-411b-a722-dc8ec2537469 at /dev/vda
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaffb0e49-4f, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:46:20 user nova-compute[75203]: INFO os_vif [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:81:29,bridge_name='br-int',has_traffic_filtering=True,id=affb0e49-4f17-4c2f-bc13-ac14942a1f0e,network=Network(fc87f44f-12b8-4ddf-b483-edf372bad0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaffb0e49-4f')
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [req-b84820d4-8145-4e3e-b2a3-f8a05885bfdc req-c2ce0e31-94a7-4289-9221-768d16ac11cd service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:20 user nova-compute[75203]:   <nova:package version="0.0.0"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:name>tempest-device-tagging-server-2003045023</nova:name>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:creationTime>2023-11-28 18:46:20</nova:creationTime>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:flavor name="m1.tiny">
Nov 28 18:46:20 user nova-compute[75203]:     <nova:memory>512</nova:memory>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:disk>1</nova:disk>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:swap>0</nova:swap>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:flavor>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:user uuid="9ca19ed1c66845259ec4a7aac7b9d611">tempest-TaggedAttachmentsTest-228420283-project-member</nova:user>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:project uuid="46c1fcb569344efe86c3ef2744817065">tempest-TaggedAttachmentsTest-228420283</nova:project>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:owner>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:46:20 user nova-compute[75203]:   <nova:ports>
Nov 28 18:46:20 user nova-compute[75203]:     <nova:port uuid="aa825c53-e639-46d8-8e5c-91f08c239f9e">
Nov 28 18:46:20 user nova-compute[75203]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 28 18:46:20 user nova-compute[75203]:     </nova:port>
Nov 28 18:46:20 user nova-compute[75203]:   </nova:ports>
Nov 28 18:46:20 user nova-compute[75203]: </nova:instance>
Nov 28 18:46:20 user nova-compute[75203]:  {{(pid=75203) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.policy [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b7ea4623ff14b2ea244c31ac84dd600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '974923cb2e06473bbd8e4122888494df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.utils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb31c867-7408-4fe7-b8ce-cecc88ea3bac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb9b7f7-17e4-4733-bcfd-95317c340e4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d57624-9941-4b82-bc43-9019bba39d17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[02678113-c666-4a57-92a8-8d51ab09c6cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:46:20 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:46:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[348c7905-04d6-45c7-baac-e53b25070cf1]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG os_brick.utils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:46:20 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating existing volume attachment record: b93696fe-a17d-4376-a1a6-0107d15439e6 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [{"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Releasing lock "refresh_cache-177bbb95-7d1b-4c19-b3fd-182653317455" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9e752406-4bf5-4c85-8e6a-d510bd3cb1bc tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "interface-177bbb95-7d1b-4c19-b3fd-182653317455-affb0e49-4f17-4c2f-bc13-ac14942a1f0e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.920s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26636316461623065', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636316461623065', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.objects.instance [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:46:21 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:46:21 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 18:46:21 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:46:21 user nova-compute[75203]:   <serial>de1b1094-fd91-4aa4-aab0-f36e15d4067e</serial>
Nov 28 18:46:21 user nova-compute[75203]: </disk>
Nov 28 18:46:21 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Successfully created port: 0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] No VIF found with MAC fa:16:3e:cd:aa:27, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:46:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e53cfc84-1f85-42af-8f9e-96a20793a077 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.141s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Successfully updated port: 0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquired lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-changed-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Refreshing instance network info cache due to event network-changed-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] Acquiring lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating instance_info_cache with network_info: [{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Releasing lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance network_info: |[{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] Acquired lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:46:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Refreshing network info cache for port 0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:46:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:23 user nova-compute[75203]: DEBUG nova.network.neutron [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updated VIF entry in instance network info cache for port 0ef728cc-e4b3-4167-a71c-5f4e2b1a9663. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:46:23 user nova-compute[75203]: DEBUG nova.network.neutron [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating instance_info_cache with network_info: [{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-cf498725-f685-4631-8d87-bc0fa48a7824 req-ef7f50d1-553f-4e25-88f7-eb40b2cf20cd service nova] Releasing lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:46:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:24 user nova-compute[75203]: INFO nova.compute.manager [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Detaching volume de1b1094-fd91-4aa4-aab0-f36e15d4067e
Nov 28 18:46:24 user nova-compute[75203]: INFO nova.virt.block_device [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Attempting to driver detach volume de1b1094-fd91-4aa4-aab0-f36e15d4067e from mountpoint /dev/vdb
Nov 28 18:46:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Attempting to detach device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:46:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:46:24 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:46:24 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 18:46:24 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:46:24 user nova-compute[75203]:   <serial>de1b1094-fd91-4aa4-aab0-f36e15d4067e</serial>
Nov 28 18:46:24 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:46:24 user nova-compute[75203]: </disk>
Nov 28 18:46:24 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:46:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the persistent domain config.
Nov 28 18:46:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:46:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:46:24 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:46:24 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 18:46:24 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:46:24 user nova-compute[75203]:   <serial>de1b1094-fd91-4aa4-aab0-f36e15d4067e</serial>
Nov 28 18:46:24 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:46:24 user nova-compute[75203]: </disk>
Nov 28 18:46:24 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:46:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:46:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:46:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Creating image(s)
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Ensure instance console log exists: /opt/stack/data/nova/instances/cf87ffa2-f1e7-49c1-8b09-51a5d080b652/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Start _get_guest_xml network_info=[{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cf87ffa2-f1e7-49c1-8b09-51a5d080b652', 'attached_at': '', 'detached_at': '', 'volume_id': '9b67fbfb-6046-411b-a722-dc8ec2537469', 'serial': '9b67fbfb-6046-411b-a722-dc8ec2537469'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'b93696fe-a17d-4376-a1a6-0107d15439e6', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:46:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:46:28 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:46:28 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:46:28 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae733f2-8896-41cd-b0f1-b8c8aeaac758]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:46:28 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9658f302-b2ff-4399-823d-aef97a5b6622]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469] added
Nov 28 18:46:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3955939-018c-47bc-a180-4a6fceb58cb3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a42553a-634a-4954-9531-5486f6a96242]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRkOCZbs {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRkOCZbs" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c29ca9-f34e-4dc7-b7f5-1716bfb029d1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRkOCZbs'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c4e6a-fe29-4678-b054-f65b52a0e7e1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9787619f-403b-47e7-939d-f8b28547b0cd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da393a0-49eb-4ea8-aa62-d52346790887]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]
Nov 28 18:46:28 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.
Nov 28 18:46:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f6d157-0615-4d1d-8efc-ba67e1954e44]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5745081-8cee-44f6-af84-094bba1edf4d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:46:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:28 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:46:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d24294-1ae7-4ff9-9a8e-afa92fc8f1d7]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26233643266333162', 'path': '/dev/sdf'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233643266333162', 'path': '/dev/sdf'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405371006',display_name='tempest-ServerActionsTestOtherA-server-1405371006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405371006',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvxg74h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=cf87ffa2-f1e7-49c1-8b09-51a5d080b652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'pci_devices' on Instance uuid cf87ffa2-f1e7-49c1-8b09-51a5d080b652 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:46:29 user nova-compute[75203]:   <uuid>cf87ffa2-f1e7-49c1-8b09-51a5d080b652</uuid>
Nov 28 18:46:29 user nova-compute[75203]:   <name>instance-00000019</name>
Nov 28 18:46:29 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:46:29 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:46:29 user nova-compute[75203]:   <metadata>
Nov 28 18:46:29 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:29 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:46:29 user nova-compute[75203]:       <nova:name>tempest-ServerActionsTestOtherA-server-1405371006</nova:name>
Nov 28 18:46:29 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:46:28</nova:creationTime>
Nov 28 18:46:29 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:46:29 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:46:29 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:46:29 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:46:29 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:29 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:29 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:46:29 user nova-compute[75203]:       <nova:owner>
Nov 28 18:46:29 user nova-compute[75203]:         <nova:user uuid="4b7ea4623ff14b2ea244c31ac84dd600">tempest-ServerActionsTestOtherA-1893596751-project-member</nova:user>
Nov 28 18:46:29 user nova-compute[75203]:         <nova:project uuid="974923cb2e06473bbd8e4122888494df">tempest-ServerActionsTestOtherA-1893596751</nova:project>
Nov 28 18:46:29 user nova-compute[75203]:       </nova:owner>
Nov 28 18:46:29 user nova-compute[75203]:       <nova:ports>
Nov 28 18:46:29 user nova-compute[75203]:         <nova:port uuid="0ef728cc-e4b3-4167-a71c-5f4e2b1a9663">
Nov 28 18:46:29 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 18:46:29 user nova-compute[75203]:         </nova:port>
Nov 28 18:46:29 user nova-compute[75203]:       </nova:ports>
Nov 28 18:46:29 user nova-compute[75203]:     </nova:instance>
Nov 28 18:46:29 user nova-compute[75203]:   </metadata>
Nov 28 18:46:29 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:46:29 user nova-compute[75203]:     <system>
Nov 28 18:46:29 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:46:29 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:46:29 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:46:29 user nova-compute[75203]:       <entry name="serial">cf87ffa2-f1e7-49c1-8b09-51a5d080b652</entry>
Nov 28 18:46:29 user nova-compute[75203]:       <entry name="uuid">cf87ffa2-f1e7-49c1-8b09-51a5d080b652</entry>
Nov 28 18:46:29 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:46:29 user nova-compute[75203]:     </system>
Nov 28 18:46:29 user nova-compute[75203]:   </sysinfo>
Nov 28 18:46:29 user nova-compute[75203]:   <os>
Nov 28 18:46:29 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:46:29 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:46:29 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:46:29 user nova-compute[75203]:   </os>
Nov 28 18:46:29 user nova-compute[75203]:   <features>
Nov 28 18:46:29 user nova-compute[75203]:     <acpi/>
Nov 28 18:46:29 user nova-compute[75203]:     <apic/>
Nov 28 18:46:29 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:46:29 user nova-compute[75203]:   </features>
Nov 28 18:46:29 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:46:29 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:46:29 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:46:29 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:46:29 user nova-compute[75203]:   </clock>
Nov 28 18:46:29 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:46:29 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:46:29 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:46:29 user nova-compute[75203]:   </cpu>
Nov 28 18:46:29 user nova-compute[75203]:   <devices>
Nov 28 18:46:29 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:46:29 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:46:29 user nova-compute[75203]:       <source dev="/dev/sdf"/>
Nov 28 18:46:29 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:46:29 user nova-compute[75203]:       <serial>9b67fbfb-6046-411b-a722-dc8ec2537469</serial>
Nov 28 18:46:29 user nova-compute[75203]:     </disk>
Nov 28 18:46:29 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:46:29 user nova-compute[75203]:       <mac address="fa:16:3e:95:b6:00"/>
Nov 28 18:46:29 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:46:29 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:46:29 user nova-compute[75203]:       <target dev="tap0ef728cc-e4"/>
Nov 28 18:46:29 user nova-compute[75203]:     </interface>
Nov 28 18:46:29 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:46:29 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/cf87ffa2-f1e7-49c1-8b09-51a5d080b652/console.log" append="off"/>
Nov 28 18:46:29 user nova-compute[75203]:     </serial>
Nov 28 18:46:29 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:46:29 user nova-compute[75203]:     <video>
Nov 28 18:46:29 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:46:29 user nova-compute[75203]:     </video>
Nov 28 18:46:29 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:46:29 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:46:29 user nova-compute[75203]:     </rng>
Nov 28 18:46:29 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:46:29 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:46:29 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:46:29 user nova-compute[75203]:     </memballoon>
Nov 28 18:46:29 user nova-compute[75203]:   </devices>
Nov 28 18:46:29 user nova-compute[75203]: </domain>
Nov 28 18:46:29 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405371006',display_name='tempest-ServerActionsTestOtherA-server-1405371006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405371006',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvxg74h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=cf87ffa2-f1e7-49c1-8b09-51a5d080b652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG os_vif [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e200294b-51fe-5d28-b4d1-860ab6af56fe', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ef728cc-e4, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ef728cc-e4, col_values=(('qos', UUID('714eae86-372a-48ef-9ec7-384f4011d513')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ef728cc-e4, col_values=(('external_ids', {'iface-id': '0ef728cc-e4b3-4167-a71c-5f4e2b1a9663', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:b6:00', 'vm-uuid': 'cf87ffa2-f1e7-49c1-8b09-51a5d080b652'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:29 user nova-compute[75203]: INFO os_vif [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4')
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:46:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No VIF found with MAC fa:16:3e:95:b6:00, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:46:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-58bec9fb-e316-403f-a517-e35565630df5 req-9caf4bcd-b445-4bcb-bb10-082f8eb1b857 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-58bec9fb-e316-403f-a517-e35565630df5 req-9caf4bcd-b445-4bcb-bb10-082f8eb1b857 service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-58bec9fb-e316-403f-a517-e35565630df5 req-9caf4bcd-b445-4bcb-bb10-082f8eb1b857 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-58bec9fb-e316-403f-a517-e35565630df5 req-9caf4bcd-b445-4bcb-bb10-082f8eb1b857 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-58bec9fb-e316-403f-a517-e35565630df5 req-9caf4bcd-b445-4bcb-bb10-082f8eb1b857 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:31 user nova-compute[75203]: WARNING nova.compute.manager [req-58bec9fb-e316-403f-a517-e35565630df5 req-9caf4bcd-b445-4bcb-bb10-082f8eb1b857 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received unexpected event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with vm_state building and task_state spawning.
Nov 28 18:46:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-7e9661a6-3caf-4fd7-9769-696d5a953d36 req-d16e4865-0933-4259-b9be-ff5b8489f1a0 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7e9661a6-3caf-4fd7-9769-696d5a953d36 req-d16e4865-0933-4259-b9be-ff5b8489f1a0 service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7e9661a6-3caf-4fd7-9769-696d5a953d36 req-d16e4865-0933-4259-b9be-ff5b8489f1a0 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7e9661a6-3caf-4fd7-9769-696d5a953d36 req-d16e4865-0933-4259-b9be-ff5b8489f1a0 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-7e9661a6-3caf-4fd7-9769-696d5a953d36 req-d16e4865-0933-4259-b9be-ff5b8489f1a0 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:33 user nova-compute[75203]: WARNING nova.compute.manager [req-7e9661a6-3caf-4fd7-9769-696d5a953d36 req-d16e4865-0933-4259-b9be-ff5b8489f1a0 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received unexpected event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with vm_state building and task_state spawning.
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:46:33 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance spawned successfully.
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:46:33 user nova-compute[75203]: INFO nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 28 18:46:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:46:33 user nova-compute[75203]: INFO nova.compute.manager [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Took 13.66 seconds to build instance.
Nov 28 18:46:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9a4e8eac-0b75-4f77-9f05-18436cb942c1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.763s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:43 user nova-compute[75203]: INFO nova.compute.manager [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Terminating instance
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-2c623d3b-69f2-49f9-9035-d4e8a2320088 req-3a4298d2-8726-4725-bb74-d501d695428f service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received event network-vif-unplugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2c623d3b-69f2-49f9-9035-d4e8a2320088 req-3a4298d2-8726-4725-bb74-d501d695428f service nova] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2c623d3b-69f2-49f9-9035-d4e8a2320088 req-3a4298d2-8726-4725-bb74-d501d695428f service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2c623d3b-69f2-49f9-9035-d4e8a2320088 req-3a4298d2-8726-4725-bb74-d501d695428f service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-2c623d3b-69f2-49f9-9035-d4e8a2320088 req-3a4298d2-8726-4725-bb74-d501d695428f service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] No waiting events found dispatching network-vif-unplugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-2c623d3b-69f2-49f9-9035-d4e8a2320088 req-3a4298d2-8726-4725-bb74-d501d695428f service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received event network-vif-unplugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Instance destroyed successfully.
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lazy-loading 'resources' on Instance uuid 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1638521000',display_name='tempest-ServersNegativeTestJSON-server-1638521000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1638521000',id=13,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e89044cd2ec4716af0b204c9b107772',ramdisk_id='',reservation_id='r-bnd727ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-617619106',owner_user_name='tempest-ServersNegativeTestJSON-617619106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:38:05Z,user_data=None,user_id='72568e67e6f34f6584962ffea5d48f6f',uuid=092dc38f-5bfc-47ba-8cc2-61cf2eea21f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converting VIF {"id": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "address": "fa:16:3e:ce:c6:e6", "network": {"id": "e5dee64e-7888-4ac3-bc97-e5dbc94f965c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-143854075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e89044cd2ec4716af0b204c9b107772", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba4460a-57", "ovs_interfaceid": "7ba4460a-57bd-4b62-945e-9878a64dfa5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:c6:e6,bridge_name='br-int',has_traffic_filtering=True,id=7ba4460a-57bd-4b62-945e-9878a64dfa5a,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4460a-57') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG os_vif [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:c6:e6,bridge_name='br-int',has_traffic_filtering=True,id=7ba4460a-57bd-4b62-945e-9878a64dfa5a,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4460a-57') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ba4460a-57, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=276491d7-fc45-4293-9c0f-9cdea198f2a3) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:43 user nova-compute[75203]: INFO os_vif [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:c6:e6,bridge_name='br-int',has_traffic_filtering=True,id=7ba4460a-57bd-4b62-945e-9878a64dfa5a,network=Network(e5dee64e-7888-4ac3-bc97-e5dbc94f965c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba4460a-57')
Nov 28 18:46:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Deleting instance files /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0_del
Nov 28 18:46:43 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Deletion of /opt/stack/data/nova/instances/092dc38f-5bfc-47ba-8cc2-61cf2eea21f0_del complete
Nov 28 18:46:43 user nova-compute[75203]: INFO nova.compute.manager [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 28 18:46:43 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:46:43 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:44 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Took 0.51 seconds to deallocate network for instance.
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-189d2213-e2bb-49e6-8ab4-e65fa5de0fc9 req-5bceae27-6737-49df-9d63-bf4fe1e260bf service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received event network-vif-deleted-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:44 user nova-compute[75203]: INFO nova.compute.manager [req-189d2213-e2bb-49e6-8ab4-e65fa5de0fc9 req-5bceae27-6737-49df-9d63-bf4fe1e260bf service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Neutron deleted interface 7ba4460a-57bd-4b62-945e-9878a64dfa5a; detaching it from the instance and deleting it from the info cache
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.network.neutron [req-189d2213-e2bb-49e6-8ab4-e65fa5de0fc9 req-5bceae27-6737-49df-9d63-bf4fe1e260bf service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-189d2213-e2bb-49e6-8ab4-e65fa5de0fc9 req-5bceae27-6737-49df-9d63-bf4fe1e260bf service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Detach interface failed, port_id=7ba4460a-57bd-4b62-945e-9878a64dfa5a, reason: Instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:46:44 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 is timed out.
Nov 28 18:46:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully detached device vdb from instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 from the live domain config.
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNzVaoxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:46:44 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4b8ec3-51a1-4ed9-a8a6-a195154d1f05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:46:44 user nova-compute[75203]: No targets found.
Nov 28 18:46:44 user nova-compute[75203]: iSNS:
Nov 28 18:46:44 user nova-compute[75203]: No targets found.
Nov 28 18:46:44 user nova-compute[75203]: STATIC:
Nov 28 18:46:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:46:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:46:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:46:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:46:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:46:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:46:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:46:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:46:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:46:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469
Nov 28 18:46:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:46:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:46:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e
Nov 28 18:46:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:46:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:46:44 user nova-compute[75203]: FIRMWARE:
Nov 28 18:46:44 user nova-compute[75203]: No targets found.
Nov 28 18:46:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:46:44 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:46:44 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eef110-ff4e-46b7-98af-e0b9e318b431]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[60496387-8fc8-4277-a763-822a30b333eb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:46:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e (non-flash)
Nov 28 18:46:44 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:46:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07902a1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e'): ({'sdd'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Removing single pathed devices sdd {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:44 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Deleted allocations for instance 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed5a43-0644-4090-988d-4b988a274411]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97ced6b-e48d-451c-b279-42661c189ba4]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Flushing IO for device /dev/sdd {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ea8f8e-6177-40cb-a482-17e799a4e5a5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:46:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[891de5d3-d6a4-4723-b30e-256dd515483b]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34c4fa36-1fdc-42e9-819d-e820ee6f5d41 tempest-ServersNegativeTestJSON-617619106 tempest-ServersNegativeTestJSON-617619106-project-member] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3b9554-e28f-4d95-b8a0-2a4d770e159d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a102d-35e0-4e65-b5dc-244a72011bde]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260]
Nov 28 18:46:45 user nova-compute[75203]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e, portal: 172.16.0.220,3260] successful.
Nov 28 18:46:45 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de1b1094-fd91-4aa4-aab0-f36e15d4067e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adbb5bf-9c73-4fae-8ab1-b9b870105537]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] <== disconnect_volume: return (326ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-6f4f0bdf-50e2-4b04-8f4e-23d9531a4ab9 req-3e293bae-62c1-4f0e-95a0-a5c62c9994df service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received event network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6f4f0bdf-50e2-4b04-8f4e-23d9531a4ab9 req-3e293bae-62c1-4f0e-95a0-a5c62c9994df service nova] Acquiring lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6f4f0bdf-50e2-4b04-8f4e-23d9531a4ab9 req-3e293bae-62c1-4f0e-95a0-a5c62c9994df service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6f4f0bdf-50e2-4b04-8f4e-23d9531a4ab9 req-3e293bae-62c1-4f0e-95a0-a5c62c9994df service nova] Lock "092dc38f-5bfc-47ba-8cc2-61cf2eea21f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-6f4f0bdf-50e2-4b04-8f4e-23d9531a4ab9 req-3e293bae-62c1-4f0e-95a0-a5c62c9994df service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] No waiting events found dispatching network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:45 user nova-compute[75203]: WARNING nova.compute.manager [req-6f4f0bdf-50e2-4b04-8f4e-23d9531a4ab9 req-3e293bae-62c1-4f0e-95a0-a5c62c9994df service nova] [instance: 092dc38f-5bfc-47ba-8cc2-61cf2eea21f0] Received unexpected event network-vif-plugged-7ba4460a-57bd-4b62-945e-9878a64dfa5a for instance with vm_state deleted and task_state None.
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG nova.objects.instance [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'flavor' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0cebf6cf-5faf-476b-a062-4c1577618062 tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.587s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:46:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:48 user nova-compute[75203]: INFO nova.compute.manager [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Rescuing
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating instance_info_cache with network_info: [{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-25a38b07-73d8-4cfe-82c2-35a83f397285 req-b7f20eb8-6602-4959-87fc-c78fdfa7a8bf service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-25a38b07-73d8-4cfe-82c2-35a83f397285 req-b7f20eb8-6602-4959-87fc-c78fdfa7a8bf service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-25a38b07-73d8-4cfe-82c2-35a83f397285 req-b7f20eb8-6602-4959-87fc-c78fdfa7a8bf service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-25a38b07-73d8-4cfe-82c2-35a83f397285 req-b7f20eb8-6602-4959-87fc-c78fdfa7a8bf service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-25a38b07-73d8-4cfe-82c2-35a83f397285 req-b7f20eb8-6602-4959-87fc-c78fdfa7a8bf service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:49 user nova-compute[75203]: WARNING nova.compute.manager [req-25a38b07-73d8-4cfe-82c2-35a83f397285 req-b7f20eb8-6602-4959-87fc-c78fdfa7a8bf service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state active and task_state rescuing.
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance destroyed successfully.
Nov 28 18:46:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Attempting a stable device rescue
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75203) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 18:46:50 user nova-compute[75203]: INFO nova.compute.manager [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Terminating instance
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:46:50 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Creating image(s)
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "/opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.objects.instance [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "493d047dadc87d83ec0e1367a18a7bd67cfee753" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "493d047dadc87d83ec0e1367a18a7bd67cfee753" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-d6164fdd-1e84-40f7-b97d-b42a8c974e5c req-ac4121e6-d652-417a-bde4-bfb95a210f9d service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-unplugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d6164fdd-1e84-40f7-b97d-b42a8c974e5c req-ac4121e6-d652-417a-bde4-bfb95a210f9d service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d6164fdd-1e84-40f7-b97d-b42a8c974e5c req-ac4121e6-d652-417a-bde4-bfb95a210f9d service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d6164fdd-1e84-40f7-b97d-b42a8c974e5c req-ac4121e6-d652-417a-bde4-bfb95a210f9d service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-d6164fdd-1e84-40f7-b97d-b42a8c974e5c req-ac4121e6-d652-417a-bde4-bfb95a210f9d service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-unplugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-d6164fdd-1e84-40f7-b97d-b42a8c974e5c req-ac4121e6-d652-417a-bde4-bfb95a210f9d service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-unplugged-aa825c53-e639-46d8-8e5c-91f08c239f9e for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.815s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:50 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Instance destroyed successfully.
Nov 28 18:46:50 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lazy-loading 'resources' on Instance uuid 177bbb95-7d1b-4c19-b3fd-182653317455 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:43:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2003045023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2003045023',id=23,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqhDx8npFjhQdkpVV5BmnfW0cypqo9A9ZH2uShjWYJ964vJ658J3nwHB9aKqKSt941+t9JkEop8s8ttkn7sPooQDbH5A2W6tXp1PXzHTyOhEIg31YOlbOOu/YCLDMmg5g==',key_name='tempest-keypair-1489127069',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:43:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46c1fcb569344efe86c3ef2744817065',ramdisk_id='',reservation_id='r-502u6m5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-228420283',owner_user_name='tempest-TaggedAttachmentsTest-228420283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ca19ed1c66845259ec4a7aac7b9d611',uuid=177bbb95-7d1b-4c19-b3fd-182653317455,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converting VIF {"id": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "address": "fa:16:3e:19:2b:8d", "network": {"id": "caf18f37-242a-4180-8d6d-ac4999e4daf0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1540716562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c1fcb569344efe86c3ef2744817065", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa825c53-e6", "ovs_interfaceid": "aa825c53-e639-46d8-8e5c-91f08c239f9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:2b:8d,bridge_name='br-int',has_traffic_filtering=True,id=aa825c53-e639-46d8-8e5c-91f08c239f9e,network=Network(caf18f37-242a-4180-8d6d-ac4999e4daf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa825c53-e6') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG os_vif [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:2b:8d,bridge_name='br-int',has_traffic_filtering=True,id=aa825c53-e639-46d8-8e5c-91f08c239f9e,network=Network(caf18f37-242a-4180-8d6d-ac4999e4daf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa825c53-e6') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa825c53-e6, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc9be8f6-279a-489e-80e6-ebe839996649) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:51 user nova-compute[75203]: INFO os_vif [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:2b:8d,bridge_name='br-int',has_traffic_filtering=True,id=aa825c53-e639-46d8-8e5c-91f08c239f9e,network=Network(caf18f37-242a-4180-8d6d-ac4999e4daf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa825c53-e6')
Nov 28 18:46:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Deleting instance files /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455_del
Nov 28 18:46:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Deletion of /opt/stack/data/nova/instances/177bbb95-7d1b-4c19-b3fd-182653317455_del complete
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.virt.images [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] 630401b6-1785-4842-ad4f-d7435ca6f5a5 was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.part /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:51 user nova-compute[75203]: INFO nova.compute.manager [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-392123bc-fcd2-4d5b-8eb3-9571acb7e23a req-db29f585-1433-40a6-aeb7-be14c78d6de7 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-392123bc-fcd2-4d5b-8eb3-9571acb7e23a req-db29f585-1433-40a6-aeb7-be14c78d6de7 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-392123bc-fcd2-4d5b-8eb3-9571acb7e23a req-db29f585-1433-40a6-aeb7-be14c78d6de7 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-392123bc-fcd2-4d5b-8eb3-9571acb7e23a req-db29f585-1433-40a6-aeb7-be14c78d6de7 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-392123bc-fcd2-4d5b-8eb3-9571acb7e23a req-db29f585-1433-40a6-aeb7-be14c78d6de7 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:51 user nova-compute[75203]: WARNING nova.compute.manager [req-392123bc-fcd2-4d5b-8eb3-9571acb7e23a req-db29f585-1433-40a6-aeb7-be14c78d6de7 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state active and task_state rescuing.
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.part /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.converted" returned: 0 in 0.724s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "493d047dadc87d83ec0e1367a18a7bd67cfee753" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.919s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "493d047dadc87d83ec0e1367a18a7bd67cfee753" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "493d047dadc87d83ec0e1367a18a7bd67cfee753" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:52 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Took 0.93 seconds to deallocate network for instance.
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753 --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753,backing_fmt=raw /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.rescue {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753,backing_fmt=raw /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.rescue" returned: 0 in 0.046s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "493d047dadc87d83ec0e1367a18a7bd67cfee753" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'migration_context' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<33b41c79-f029-473d-b6c8-8b3ec206be68> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Start _get_guest_xml network_info=[{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "vif_mac": "fa:16:3e:9d:09:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '630401b6-1785-4842-ad4f-d7435ca6f5a5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyCxeuVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '33b41c79-f029-473d-b6c8-8b3ec206be68', 'attached_at': '', 'detached_at': '', 'volume_id': '4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'serial': '4dc5ab62-885a-471f-af6d-e8fd39051f1e'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'ef459e14-f7b7-4b80-83c2-9c0ec110e679', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'resources' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<33b41c79-f029-473d-b6c8-8b3ec206be68> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'numa_topology' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<33b41c79-f029-473d-b6c8-8b3ec206be68> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '177bbb95-7d1b-4c19-b3fd-182653317455' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '177bbb95-7d1b-4c19-b3fd-182653317455' (instance-00000017)
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<33b41c79-f029-473d-b6c8-8b3ec206be68> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyCxeuVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:46:52 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:46:52 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:46:52 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc471b2-826e-41a1-989b-e63bfc16a894]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gyCxeuVh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-9926f6ea-e317-48a7-9cae-a130b9fbd2a4 req-48a66c15-6e14-4e85-887a-40ad876a4c37 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9926f6ea-e317-48a7-9cae-a130b9fbd2a4 req-48a66c15-6e14-4e85-887a-40ad876a4c37 service nova] Acquiring lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9926f6ea-e317-48a7-9cae-a130b9fbd2a4 req-48a66c15-6e14-4e85-887a-40ad876a4c37 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9926f6ea-e317-48a7-9cae-a130b9fbd2a4 req-48a66c15-6e14-4e85-887a-40ad876a4c37 service nova] Lock "177bbb95-7d1b-4c19-b3fd-182653317455-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-9926f6ea-e317-48a7-9cae-a130b9fbd2a4 req-48a66c15-6e14-4e85-887a-40ad876a4c37 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] No waiting events found dispatching network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:52 user nova-compute[75203]: WARNING nova.compute.manager [req-9926f6ea-e317-48a7-9cae-a130b9fbd2a4 req-48a66c15-6e14-4e85-887a-40ad876a4c37 service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received unexpected event network-vif-plugged-aa825c53-e639-46d8-8e5c-91f08c239f9e for instance with vm_state deleted and task_state None.
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 18:46:52 user nova-compute[75203]: node.name = iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:46:52 user nova-compute[75203]: node.tpgt = -1
Nov 28 18:46:52 user nova-compute[75203]: node.startup = automatic
Nov 28 18:46:52 user nova-compute[75203]: node.leading_login = No
Nov 28 18:46:52 user nova-compute[75203]: iface.iscsi_ifacename = default
Nov 28 18:46:52 user nova-compute[75203]: iface.net_ifacename = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.ipaddress = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.prefix_len = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.hwaddress = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.transport_name = tcp
Nov 28 18:46:52 user nova-compute[75203]: iface.initiatorname = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.state = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.vlan_id = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.vlan_priority = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.vlan_state = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.iface_num = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.mtu = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.port = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.bootproto = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.subnet_mask = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.gateway = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_alt_client_id = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_dns = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_learn_iqn = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_vendor_id_state = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_vendor_id = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.dhcp_slp_da = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.fragmentation = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.gratuitous_arp = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.incoming_forwarding = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.tos_state = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.tos = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.ttl = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.delayed_ack = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.tcp_nagle = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.tcp_wsf_state = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.tcp_wsf = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.tcp_timer_scale = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.tcp_timestamp = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.redirect = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.def_task_mgmt_timeout = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.header_digest = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.data_digest = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.immediate_data = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.initial_r2t = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.data_seq_inorder = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.data_pdu_inorder = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.erl = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.max_receive_data_len = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.first_burst_len = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.max_outstanding_r2t = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.max_burst_len = 0
Nov 28 18:46:52 user nova-compute[75203]: iface.chap_auth = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.bidi_chap = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.strict_login_compliance = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.discovery_auth = <empty>
Nov 28 18:46:52 user nova-compute[75203]: iface.discovery_logout = <empty>
Nov 28 18:46:52 user nova-compute[75203]: node.discovery_address = <empty>
Nov 28 18:46:52 user nova-compute[75203]: node.discovery_port = 0
Nov 28 18:46:52 user nova-compute[75203]: node.discovery_type = static
Nov 28 18:46:52 user nova-compute[75203]: node.session.initial_cmdsn = 0
Nov 28 18:46:52 user nova-compute[75203]: node.session.initial_login_retry_max = 8
Nov 28 18:46:52 user nova-compute[75203]: node.session.xmit_thread_priority = -20
Nov 28 18:46:52 user nova-compute[75203]: node.session.cmds_max = 128
Nov 28 18:46:52 user nova-compute[75203]: node.session.queue_depth = 32
Nov 28 18:46:52 user nova-compute[75203]: node.session.nr_sessions = 1
Nov 28 18:46:52 user nova-compute[75203]: node.session.auth.authmethod = CHAP
Nov 28 18:46:52 user nova-compute[75203]: node.session.auth.username = gyCxeuVh
Nov 28 18:46:52 user nova-compute[75203]: node.session.auth.password = ***
Nov 28 18:46:52 user nova-compute[75203]: node.session.auth.username_in = <empty>
Nov 28 18:46:52 user nova-compute[75203]: node.session.auth.password_in = <empty>
Nov 28 18:46:52 user nova-compute[75203]: node.session.auth.chap_algs = MD5
Nov 28 18:46:52 user nova-compute[75203]: node.session.timeo.replacement_timeout = 120
Nov 28 18:46:52 user nova-compute[75203]: node.session.err_timeo.abort_timeout = 15
Nov 28 18:46:52 user nova-compute[75203]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 18:46:52 user nova-compute[75203]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 18:46:52 user nova-compute[75203]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.FastAbort = Yes
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.InitialR2T = No
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.ImmediateData = Yes
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.MaxConnections = 1
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 18:46:52 user nova-compute[75203]: node.session.iscsi.ERL = 0
Nov 28 18:46:52 user nova-compute[75203]: node.session.scan = manual
Nov 28 18:46:52 user nova-compute[75203]: node.session.reopen_max = 0
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].address = 172.16.0.220
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].port = 3260
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].startup = manual
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].tcp.window_size = 524288
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].tcp.type_of_service = 0
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].timeo.logout_timeout = 15
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].timeo.login_timeout = 15
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].timeo.auth_timeout = 45
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].iscsi.DataDigest = None
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].iscsi.IFMarker = No
Nov 28 18:46:52 user nova-compute[75203]: node.conn[0].iscsi.OFMarker = No
Nov 28 18:46:52 user nova-compute[75203]: # END RECORD
Nov 28 18:46:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7633MB free_disk=25.086257934570312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[86edb3b9-5645-4c6b-ab71-3ae1d10e2543]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[254b734f-1af1-48e0-94fd-ce36887df3c6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyCxeuVh {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyCxeuVh" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450987d-9094-451c-b400-54464e684a51]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gyCxeuVh'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b65ef-b43b-4dcc-b309-d7dfc72524e5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[31023e61-e9e9-4921-9831-3c9a4e8ee83a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:52 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:52 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:52 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:46:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:46:52 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:46:52 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:46:52 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:46:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.541s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] HCTL ('34', '0', '0', 0) found on session 23 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22a24ae-c565-42ca-99e3-b96c5c7692e2]: (4, ('0 0 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching for a device in session 23 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyCxeuVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.565s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== connect_volume: return (566ms) {'type': 'block', 'scsi_wwn': '23138666438643034', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138666438643034', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1657601046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1657601046',id=24,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-z19gbbkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:45:16Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=33b41c79-f029-473d-b6c8-8b3ec206be68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "vif_mac": "fa:16:3e:9d:09:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "vif_mac": "fa:16:3e:9d:09:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'pci_devices' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<33b41c79-f029-473d-b6c8-8b3ec206be68> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:46:52 user nova-compute[75203]:   <uuid>33b41c79-f029-473d-b6c8-8b3ec206be68</uuid>
Nov 28 18:46:52 user nova-compute[75203]:   <name>instance-00000018</name>
Nov 28 18:46:52 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:46:52 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:46:52 user nova-compute[75203]:   <metadata>
Nov 28 18:46:52 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:46:52 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:46:52 user nova-compute[75203]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1657601046</nova:name>
Nov 28 18:46:52 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:46:52</nova:creationTime>
Nov 28 18:46:52 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:46:52 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:46:52 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:46:52 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:46:52 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:46:52 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:46:52 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:46:52 user nova-compute[75203]:       <nova:owner>
Nov 28 18:46:52 user nova-compute[75203]:         <nova:user uuid="ad9a9772df954da0b42b5b102440c1d0">tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member</nova:user>
Nov 28 18:46:52 user nova-compute[75203]:         <nova:project uuid="eec1aaec341d441fb4da4fc53a985617">tempest-ServerBootFromVolumeStableRescueTest-1173209255</nova:project>
Nov 28 18:46:52 user nova-compute[75203]:       </nova:owner>
Nov 28 18:46:52 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:46:52 user nova-compute[75203]:       <nova:ports>
Nov 28 18:46:52 user nova-compute[75203]:         <nova:port uuid="9d772bbd-714c-4603-9a31-3ed495ebc5a5">
Nov 28 18:46:52 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 18:46:52 user nova-compute[75203]:         </nova:port>
Nov 28 18:46:52 user nova-compute[75203]:       </nova:ports>
Nov 28 18:46:52 user nova-compute[75203]:     </nova:instance>
Nov 28 18:46:52 user nova-compute[75203]:   </metadata>
Nov 28 18:46:52 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:46:52 user nova-compute[75203]:     <system>
Nov 28 18:46:52 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:46:52 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:46:52 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:46:52 user nova-compute[75203]:       <entry name="serial">33b41c79-f029-473d-b6c8-8b3ec206be68</entry>
Nov 28 18:46:52 user nova-compute[75203]:       <entry name="uuid">33b41c79-f029-473d-b6c8-8b3ec206be68</entry>
Nov 28 18:46:52 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:46:52 user nova-compute[75203]:     </system>
Nov 28 18:46:52 user nova-compute[75203]:   </sysinfo>
Nov 28 18:46:52 user nova-compute[75203]:   <os>
Nov 28 18:46:52 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:46:52 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:46:52 user nova-compute[75203]:   </os>
Nov 28 18:46:52 user nova-compute[75203]:   <features>
Nov 28 18:46:52 user nova-compute[75203]:     <acpi/>
Nov 28 18:46:52 user nova-compute[75203]:     <apic/>
Nov 28 18:46:52 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:46:52 user nova-compute[75203]:   </features>
Nov 28 18:46:52 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:46:52 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:46:52 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:46:52 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:46:52 user nova-compute[75203]:   </clock>
Nov 28 18:46:52 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:46:52 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:46:52 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:46:52 user nova-compute[75203]:   </cpu>
Nov 28 18:46:52 user nova-compute[75203]:   <devices>
Nov 28 18:46:52 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:46:52 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:46:52 user nova-compute[75203]:       <source dev="/dev/sdc"/>
Nov 28 18:46:52 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:46:52 user nova-compute[75203]:       <serial>4dc5ab62-885a-471f-af6d-e8fd39051f1e</serial>
Nov 28 18:46:52 user nova-compute[75203]:     </disk>
Nov 28 18:46:52 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:46:52 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:46:52 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.rescue"/>
Nov 28 18:46:52 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:46:52 user nova-compute[75203]:       <boot order="1"/>
Nov 28 18:46:52 user nova-compute[75203]:     </disk>
Nov 28 18:46:52 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:46:52 user nova-compute[75203]:       <mac address="fa:16:3e:9d:09:68"/>
Nov 28 18:46:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:46:52 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:46:52 user nova-compute[75203]:       <target dev="tap9d772bbd-71"/>
Nov 28 18:46:52 user nova-compute[75203]:     </interface>
Nov 28 18:46:52 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:46:52 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/console.log" append="off"/>
Nov 28 18:46:52 user nova-compute[75203]:     </serial>
Nov 28 18:46:52 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:46:52 user nova-compute[75203]:     <video>
Nov 28 18:46:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:46:52 user nova-compute[75203]:     </video>
Nov 28 18:46:52 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:46:52 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:46:52 user nova-compute[75203]:     </rng>
Nov 28 18:46:52 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:46:52 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:46:52 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:46:52 user nova-compute[75203]:     </memballoon>
Nov 28 18:46:52 user nova-compute[75203]:   </devices>
Nov 28 18:46:52 user nova-compute[75203]: </domain>
Nov 28 18:46:52 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:46:52 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:46:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance destroyed successfully.
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.860s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.246s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No VIF found with MAC fa:16:3e:9d:09:68, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:46:53 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Deleted allocations for instance 177bbb95-7d1b-4c19-b3fd-182653317455
Nov 28 18:46:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 13524911-1006-4646-9c67-def22fb36ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 23ad8585-7fca-4c5b-b0d7-1258eb331c39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4acd9b10-0c48-47b0-8869-d6bda3f2f826 tempest-TaggedAttachmentsTest-228420283 tempest-TaggedAttachmentsTest-228420283-project-member] Lock "177bbb95-7d1b-4c19-b3fd-182653317455" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-46b50247-14c1-4dde-9314-4d5e1e0c646f req-6b0ee2d9-d9ee-402e-afa5-8bfcc6cc7a9b service nova] [instance: 177bbb95-7d1b-4c19-b3fd-182653317455] Received event network-vif-deleted-aa825c53-e639-46d8-8e5c-91f08c239f9e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [{"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-449f7a33-7a5a-4618-b840-59039ed50492" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:55 user nova-compute[75203]: WARNING nova.compute.manager [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state active and task_state rescuing.
Nov 28 18:46:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:46:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:46:55 user nova-compute[75203]: WARNING nova.compute.manager [req-3c09c749-71c0-4b9f-93ab-3548decc6ed2 req-5ef8c7fb-f3aa-4a1b-a891-40a50f965cfd service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state active and task_state rescuing.
Nov 28 18:46:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:46:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-de73f0a2-7919-4b14-a7cf-e02f4af1dff0 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:46:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:09 user nova-compute[75203]: INFO nova.compute.manager [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Unrescuing
Nov 28 18:47:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:47:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquired lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:47:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Releasing lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'flavor' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-ce5ec6a9-bd9e-4509-ab3f-6fd4da787962 req-d704dfbd-3f08-4e2d-ac70-f71bf19714e1 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ce5ec6a9-bd9e-4509-ab3f-6fd4da787962 req-d704dfbd-3f08-4e2d-ac70-f71bf19714e1 service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ce5ec6a9-bd9e-4509-ab3f-6fd4da787962 req-d704dfbd-3f08-4e2d-ac70-f71bf19714e1 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ce5ec6a9-bd9e-4509-ab3f-6fd4da787962 req-d704dfbd-3f08-4e2d-ac70-f71bf19714e1 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-ce5ec6a9-bd9e-4509-ab3f-6fd4da787962 req-d704dfbd-3f08-4e2d-ac70-f71bf19714e1 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:10 user nova-compute[75203]: WARNING nova.compute.manager [req-ce5ec6a9-bd9e-4509-ab3f-6fd4da787962 req-d704dfbd-3f08-4e2d-ac70-f71bf19714e1 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:47:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:11 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance destroyed successfully.
Nov 28 18:47:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:12 user nova-compute[75203]: WARNING nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:47:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:12 user nova-compute[75203]: WARNING nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:47:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:12 user nova-compute[75203]: WARNING nova.compute.manager [req-2dc973eb-ffcb-470d-b49b-90b376b445fa req-277c965e-3e62-4987-b99d-9ed38767acbc service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:47:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4d5f22a3-3370-4b99-82ae-9665fc22a631 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:47:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:38 user nova-compute[75203]: INFO nova.compute.manager [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Terminating instance
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-9c686942-3ba3-41e6-b09f-a97253ead9d5 req-a0e94610-6a0d-4328-9113-6d3743d3d162 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-unplugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9c686942-3ba3-41e6-b09f-a97253ead9d5 req-a0e94610-6a0d-4328-9113-6d3743d3d162 service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9c686942-3ba3-41e6-b09f-a97253ead9d5 req-a0e94610-6a0d-4328-9113-6d3743d3d162 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9c686942-3ba3-41e6-b09f-a97253ead9d5 req-a0e94610-6a0d-4328-9113-6d3743d3d162 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-9c686942-3ba3-41e6-b09f-a97253ead9d5 req-a0e94610-6a0d-4328-9113-6d3743d3d162 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-unplugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-9c686942-3ba3-41e6-b09f-a97253ead9d5 req-a0e94610-6a0d-4328-9113-6d3743d3d162 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-unplugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Instance destroyed successfully.
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lazy-loading 'resources' on Instance uuid 621d6e6b-cf0b-45fd-850e-3145f5687ab3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-207108617',display_name='tempest-SnapshotDataIntegrityTests-server-207108617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-207108617',id=19,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCU0CpAWHbaSz3sHHi74KPTj0A0btntjHNwfHZnBt8gkX53k8K9QZx4//fAXu8pCSoBkym/5tyn0owGWG7C7pbMYDpjXiSJ0GbWF05qFa1mRhggs4Soz8MP6MYfMzrjcw==',key_name='tempest-keypair-720257294',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:41:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90372eff92684a44a7d5a4f3c1583828',ramdisk_id='',reservation_id='r-58uo9h2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1392221729',owner_user_name='tempest-SnapshotDataIntegrityTests-1392221729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:41:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693208da309146e9ba35bd3fd123cd89',uuid=621d6e6b-cf0b-45fd-850e-3145f5687ab3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Converting VIF {"id": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "address": "fa:16:3e:cd:aa:27", "network": {"id": "d9b2c16d-fbb7-46c0-a429-0031922cf5ff", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-694508662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90372eff92684a44a7d5a4f3c1583828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a3b3dcb-d3", "ovs_interfaceid": "3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e,network=Network(d9b2c16d-fbb7-46c0-a429-0031922cf5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3b3dcb-d3') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG os_vif [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e,network=Network(d9b2c16d-fbb7-46c0-a429-0031922cf5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3b3dcb-d3') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a3b3dcb-d3, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4268474c-3bdb-47ee-bfaa-a6d06d8caafc) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: INFO os_vif [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e,network=Network(d9b2c16d-fbb7-46c0-a429-0031922cf5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a3b3dcb-d3')
Nov 28 18:47:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Deleting instance files /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3_del
Nov 28 18:47:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Deletion of /opt/stack/data/nova/instances/621d6e6b-cf0b-45fd-850e-3145f5687ab3_del complete
Nov 28 18:47:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:38 user nova-compute[75203]: INFO nova.compute.manager [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 18:47:38 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:47:38 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:47:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-301d3716-aa0d-4f7c-8f12-ed015c2b1b88 req-244ef669-a91b-4bca-b9dd-1290297b7911 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-deleted-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:40 user nova-compute[75203]: INFO nova.compute.manager [req-301d3716-aa0d-4f7c-8f12-ed015c2b1b88 req-244ef669-a91b-4bca-b9dd-1290297b7911 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Neutron deleted interface 3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e; detaching it from the instance and deleting it from the info cache
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.network.neutron [req-301d3716-aa0d-4f7c-8f12-ed015c2b1b88 req-244ef669-a91b-4bca-b9dd-1290297b7911 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:47:40 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Took 1.41 seconds to deallocate network for instance.
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-301d3716-aa0d-4f7c-8f12-ed015c2b1b88 req-244ef669-a91b-4bca-b9dd-1290297b7911 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Detach interface failed, port_id=3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e, reason: Instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:40 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Deleted allocations for instance 621d6e6b-cf0b-45fd-850e-3145f5687ab3
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:40 user nova-compute[75203]: WARNING nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received unexpected event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with vm_state deleted and task_state None.
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:40 user nova-compute[75203]: WARNING nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received unexpected event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with vm_state deleted and task_state None.
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:40 user nova-compute[75203]: WARNING nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received unexpected event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with vm_state deleted and task_state None.
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-unplugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-unplugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:40 user nova-compute[75203]: WARNING nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received unexpected event network-vif-unplugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with vm_state deleted and task_state None.
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Acquiring lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] No waiting events found dispatching network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:40 user nova-compute[75203]: WARNING nova.compute.manager [req-841dde8b-facb-4f51-a9d4-01ce1030adc2 req-ff9a1e78-3a2a-484f-b9c7-98e6189ccde7 service nova] [instance: 621d6e6b-cf0b-45fd-850e-3145f5687ab3] Received unexpected event network-vif-plugged-3a3b3dcb-d3ba-4a8c-9296-e050cb9d659e for instance with vm_state deleted and task_state None.
Nov 28 18:47:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1657ecf-9af7-4472-b88d-93294e60b2ef tempest-SnapshotDataIntegrityTests-1392221729 tempest-SnapshotDataIntegrityTests-1392221729-project-member] Lock "621d6e6b-cf0b-45fd-850e-3145f5687ab3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.860s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:47 user nova-compute[75203]: INFO nova.compute.manager [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Terminating instance
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-73f32fa5-bdb7-4919-85ba-6984103143d5 req-f3fafcce-d5cb-4b76-9c55-54a2c29b76ed service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-unplugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-73f32fa5-bdb7-4919-85ba-6984103143d5 req-f3fafcce-d5cb-4b76-9c55-54a2c29b76ed service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-73f32fa5-bdb7-4919-85ba-6984103143d5 req-f3fafcce-d5cb-4b76-9c55-54a2c29b76ed service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-73f32fa5-bdb7-4919-85ba-6984103143d5 req-f3fafcce-d5cb-4b76-9c55-54a2c29b76ed service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-73f32fa5-bdb7-4919-85ba-6984103143d5 req-f3fafcce-d5cb-4b76-9c55-54a2c29b76ed service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-unplugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-73f32fa5-bdb7-4919-85ba-6984103143d5 req-f3fafcce-d5cb-4b76-9c55-54a2c29b76ed service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-unplugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:47:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Instance destroyed successfully.
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lazy-loading 'resources' on Instance uuid 23ad8585-7fca-4c5b-b0d7-1258eb331c39 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T18:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391113207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391113207',id=21,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDF9J3+Pzh3OKq4qmB7UoBTdy5lbcXGZFqgbDYOeKGR4db0mKBRX00rn92bjaSFSQz+YAMZjp1Gjlh5lgBDMBtwFUYzdHacd0OhSvQl1NzZpoh+RS0+yEauRaLtPpl1jLA==',key_name='tempest-keypair-743467751',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:46:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39b4d281e6da4779a68b17ecd896e6a2',ramdisk_id='',reservation_id='r-jmyn900h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1995055501',owner_user_name='tempest-AttachVolumeShelveTestJSON-1995055501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1a7cdac05464b9ca3ef185aafe6ea0d',uuid=23ad8585-7fca-4c5b-b0d7-1258eb331c39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converting VIF {"id": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "address": "fa:16:3e:d5:2b:4b", "network": {"id": "ac7e84b4-cb3b-42d5-8e2f-57556458c05d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-985674538-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39b4d281e6da4779a68b17ecd896e6a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc046f13-06", "ovs_interfaceid": "cc046f13-0661-4704-b2ba-6b22fc72c2b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG os_vif [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc046f13-06, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9216be0-63f3-4ee7-a03b-0b6e7048767a) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:47:47 user nova-compute[75203]: INFO os_vif [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2b:4b,bridge_name='br-int',has_traffic_filtering=True,id=cc046f13-0661-4704-b2ba-6b22fc72c2b3,network=Network(ac7e84b4-cb3b-42d5-8e2f-57556458c05d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc046f13-06')
Nov 28 18:47:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Deleting instance files /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39_del
Nov 28 18:47:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Deletion of /opt/stack/data/nova/instances/23ad8585-7fca-4c5b-b0d7-1258eb331c39_del complete
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:47:47 user nova-compute[75203]: INFO nova.compute.manager [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:47:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:47:48 user nova-compute[75203]: INFO nova.compute.claims [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Claim successful on node user
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:49 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Took 1.34 seconds to deallocate network for instance.
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.129s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-3ae3971f-0d92-498a-976f-20d790291157 req-8884142d-185d-4a70-8eec-6f38fc3416fa service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ae3971f-0d92-498a-976f-20d790291157 req-8884142d-185d-4a70-8eec-6f38fc3416fa service nova] Acquiring lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ae3971f-0d92-498a-976f-20d790291157 req-8884142d-185d-4a70-8eec-6f38fc3416fa service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ae3971f-0d92-498a-976f-20d790291157 req-8884142d-185d-4a70-8eec-6f38fc3416fa service nova] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-3ae3971f-0d92-498a-976f-20d790291157 req-8884142d-185d-4a70-8eec-6f38fc3416fa service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] No waiting events found dispatching network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:49 user nova-compute[75203]: WARNING nova.compute.manager [req-3ae3971f-0d92-498a-976f-20d790291157 req-8884142d-185d-4a70-8eec-6f38fc3416fa service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received unexpected event network-vif-plugged-cc046f13-0661-4704-b2ba-6b22fc72c2b3 for instance with vm_state deleted and task_state None.
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-3ae3971f-0d92-498a-976f-20d790291157 req-8884142d-185d-4a70-8eec-6f38fc3416fa service nova] [instance: 23ad8585-7fca-4c5b-b0d7-1258eb331c39] Received event network-vif-deleted-cc046f13-0661-4704-b2ba-6b22fc72c2b3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:47:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.policy [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e0355eaade04b2b9d377a6b2c78585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e597eb0284510980106d2de8c235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:47:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Creating image(s)
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "/opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.215s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.699s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Deleted allocations for instance 23ad8585-7fca-4c5b-b0d7-1258eb331c39
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk 1073741824" returned: 0 in 0.052s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2510959-037c-4e6d-bab3-2c181212fca6 tempest-AttachVolumeShelveTestJSON-1995055501 tempest-AttachVolumeShelveTestJSON-1995055501-project-member] Lock "23ad8585-7fca-4c5b-b0d7-1258eb331c39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.461s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Successfully created port: 8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Cannot resize image /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Ensure instance console log exists: /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Successfully updated port: 8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:47:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:47:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7756MB free_disk=25.063373565673828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquired lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-changed-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Refreshing instance network info cache due to event network-changed-8c469b22-5936-4e14-b8db-1eb192478239. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] Acquiring lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 13524911-1006-4646-9c67-def22fb36ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 449f7a33-7a5a-4618-b840-59039ed50492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b61c9405-587d-4b45-9641-7b1e2d73475a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Updating instance_info_cache with network_info: [{"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Releasing lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Instance network_info: |[{"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] Acquired lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Refreshing network info cache for port 8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:47:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Start _get_guest_xml network_info=[{"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:47:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:47:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1379046637',display_name='tempest-AttachVolumeNegativeTest-server-1379046637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1379046637',id=26,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPQWAVICBA1cBKJAJgv1HWrQ6RMOJFxDySF+mXEd/jjsKsJpPnV/qlgrJN+vgW06wpfhnV5V7tRjGsDony3d2PuwX5eUlXWYn3fxqVQbggB2rCPA6r/EUUa5Xx/rnu2dQ==',key_name='tempest-keypair-76007509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-6p0kf4mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=b61c9405-587d-4b45-9641-7b1e2d73475a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:08:3a,bridge_name='br-int',has_traffic_filtering=True,id=8c469b22-5936-4e14-b8db-1eb192478239,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c469b22-59') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'pci_devices' on Instance uuid b61c9405-587d-4b45-9641-7b1e2d73475a {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:47:52 user nova-compute[75203]:   <uuid>b61c9405-587d-4b45-9641-7b1e2d73475a</uuid>
Nov 28 18:47:52 user nova-compute[75203]:   <name>instance-0000001a</name>
Nov 28 18:47:52 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:47:52 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:47:52 user nova-compute[75203]:   <metadata>
Nov 28 18:47:52 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:47:52 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:47:52 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1379046637</nova:name>
Nov 28 18:47:52 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:47:51</nova:creationTime>
Nov 28 18:47:52 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:47:52 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:47:52 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:47:52 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:47:52 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:47:52 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:47:52 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:47:52 user nova-compute[75203]:       <nova:owner>
Nov 28 18:47:52 user nova-compute[75203]:         <nova:user uuid="7e0355eaade04b2b9d377a6b2c78585e">tempest-AttachVolumeNegativeTest-977864769-project-member</nova:user>
Nov 28 18:47:52 user nova-compute[75203]:         <nova:project uuid="d40e597eb0284510980106d2de8c235b">tempest-AttachVolumeNegativeTest-977864769</nova:project>
Nov 28 18:47:52 user nova-compute[75203]:       </nova:owner>
Nov 28 18:47:52 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:47:52 user nova-compute[75203]:       <nova:ports>
Nov 28 18:47:52 user nova-compute[75203]:         <nova:port uuid="8c469b22-5936-4e14-b8db-1eb192478239">
Nov 28 18:47:52 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 18:47:52 user nova-compute[75203]:         </nova:port>
Nov 28 18:47:52 user nova-compute[75203]:       </nova:ports>
Nov 28 18:47:52 user nova-compute[75203]:     </nova:instance>
Nov 28 18:47:52 user nova-compute[75203]:   </metadata>
Nov 28 18:47:52 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:47:52 user nova-compute[75203]:     <system>
Nov 28 18:47:52 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:47:52 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:47:52 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:47:52 user nova-compute[75203]:       <entry name="serial">b61c9405-587d-4b45-9641-7b1e2d73475a</entry>
Nov 28 18:47:52 user nova-compute[75203]:       <entry name="uuid">b61c9405-587d-4b45-9641-7b1e2d73475a</entry>
Nov 28 18:47:52 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:47:52 user nova-compute[75203]:     </system>
Nov 28 18:47:52 user nova-compute[75203]:   </sysinfo>
Nov 28 18:47:52 user nova-compute[75203]:   <os>
Nov 28 18:47:52 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:47:52 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:47:52 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:47:52 user nova-compute[75203]:   </os>
Nov 28 18:47:52 user nova-compute[75203]:   <features>
Nov 28 18:47:52 user nova-compute[75203]:     <acpi/>
Nov 28 18:47:52 user nova-compute[75203]:     <apic/>
Nov 28 18:47:52 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:47:52 user nova-compute[75203]:   </features>
Nov 28 18:47:52 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:47:52 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:47:52 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:47:52 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:47:52 user nova-compute[75203]:   </clock>
Nov 28 18:47:52 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:47:52 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:47:52 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:47:52 user nova-compute[75203]:   </cpu>
Nov 28 18:47:52 user nova-compute[75203]:   <devices>
Nov 28 18:47:52 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:47:52 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:47:52 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk"/>
Nov 28 18:47:52 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:47:52 user nova-compute[75203]:     </disk>
Nov 28 18:47:52 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:47:52 user nova-compute[75203]:       <mac address="fa:16:3e:d9:08:3a"/>
Nov 28 18:47:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:47:52 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:47:52 user nova-compute[75203]:       <target dev="tap8c469b22-59"/>
Nov 28 18:47:52 user nova-compute[75203]:     </interface>
Nov 28 18:47:52 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:47:52 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/console.log" append="off"/>
Nov 28 18:47:52 user nova-compute[75203]:     </serial>
Nov 28 18:47:52 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:47:52 user nova-compute[75203]:     <video>
Nov 28 18:47:52 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:47:52 user nova-compute[75203]:     </video>
Nov 28 18:47:52 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:47:52 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:47:52 user nova-compute[75203]:     </rng>
Nov 28 18:47:52 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:47:52 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:47:52 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:47:52 user nova-compute[75203]:     </memballoon>
Nov 28 18:47:52 user nova-compute[75203]:   </devices>
Nov 28 18:47:52 user nova-compute[75203]: </domain>
Nov 28 18:47:52 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1379046637',display_name='tempest-AttachVolumeNegativeTest-server-1379046637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1379046637',id=26,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPQWAVICBA1cBKJAJgv1HWrQ6RMOJFxDySF+mXEd/jjsKsJpPnV/qlgrJN+vgW06wpfhnV5V7tRjGsDony3d2PuwX5eUlXWYn3fxqVQbggB2rCPA6r/EUUa5Xx/rnu2dQ==',key_name='tempest-keypair-76007509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-6p0kf4mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=b61c9405-587d-4b45-9641-7b1e2d73475a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:08:3a,bridge_name='br-int',has_traffic_filtering=True,id=8c469b22-5936-4e14-b8db-1eb192478239,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c469b22-59') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG os_vif [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:08:3a,bridge_name='br-int',has_traffic_filtering=True,id=8c469b22-5936-4e14-b8db-1eb192478239,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c469b22-59') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bc4daaa-771f-5bfa-b8cb-db2d98570010', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.794s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c469b22-59, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c469b22-59, col_values=(('qos', UUID('2c6b4d0d-7199-4cf7-8ca3-3a5bd03d372c')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c469b22-59, col_values=(('external_ids', {'iface-id': '8c469b22-5936-4e14-b8db-1eb192478239', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:08:3a', 'vm-uuid': 'b61c9405-587d-4b45-9641-7b1e2d73475a'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:52 user nova-compute[75203]: INFO os_vif [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:08:3a,bridge_name='br-int',has_traffic_filtering=True,id=8c469b22-5936-4e14-b8db-1eb192478239,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c469b22-59')
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No VIF found with MAC fa:16:3e:d9:08:3a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Updated VIF entry in instance network info cache for port 8c469b22-5936-4e14-b8db-1eb192478239. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Updating instance_info_cache with network_info: [{"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27aa2eb0-b1c1-4cd8-8354-c52e1a691819 req-d795fae4-b77a-47bd-9878-0e351ea47489 service nova] Releasing lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:47:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-84a3ec95-85f4-4f98-9ac9-4f5cf7bc2fa9 req-1548243c-a326-4021-a9a3-bff8b4fbc5fc service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-84a3ec95-85f4-4f98-9ac9-4f5cf7bc2fa9 req-1548243c-a326-4021-a9a3-bff8b4fbc5fc service nova] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-84a3ec95-85f4-4f98-9ac9-4f5cf7bc2fa9 req-1548243c-a326-4021-a9a3-bff8b4fbc5fc service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-84a3ec95-85f4-4f98-9ac9-4f5cf7bc2fa9 req-1548243c-a326-4021-a9a3-bff8b4fbc5fc service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-84a3ec95-85f4-4f98-9ac9-4f5cf7bc2fa9 req-1548243c-a326-4021-a9a3-bff8b4fbc5fc service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] No waiting events found dispatching network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:54 user nova-compute[75203]: WARNING nova.compute.manager [req-84a3ec95-85f4-4f98-9ac9-4f5cf7bc2fa9 req-1548243c-a326-4021-a9a3-bff8b4fbc5fc service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received unexpected event network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 for instance with vm_state building and task_state spawning.
Nov 28 18:47:54 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:47:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:47:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Instance spawned successfully.
Nov 28 18:47:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:47:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-29c4ed21-cac2-4b89-8109-e22e845412a6 req-9bf74a8a-9511-46b9-a80b-09453ded5a3b service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-29c4ed21-cac2-4b89-8109-e22e845412a6 req-9bf74a8a-9511-46b9-a80b-09453ded5a3b service nova] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-29c4ed21-cac2-4b89-8109-e22e845412a6 req-9bf74a8a-9511-46b9-a80b-09453ded5a3b service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-29c4ed21-cac2-4b89-8109-e22e845412a6 req-9bf74a8a-9511-46b9-a80b-09453ded5a3b service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-29c4ed21-cac2-4b89-8109-e22e845412a6 req-9bf74a8a-9511-46b9-a80b-09453ded5a3b service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] No waiting events found dispatching network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:47:56 user nova-compute[75203]: WARNING nova.compute.manager [req-29c4ed21-cac2-4b89-8109-e22e845412a6 req-9bf74a8a-9511-46b9-a80b-09453ded5a3b service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received unexpected event network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 for instance with vm_state building and task_state spawning.
Nov 28 18:47:56 user nova-compute[75203]: INFO nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 28 18:47:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:47:56 user nova-compute[75203]: INFO nova.compute.manager [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Took 7.31 seconds to build instance.
Nov 28 18:47:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6d702bb2-2208-4fd1-9147-59e412cee9f2 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.414s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:47:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:47:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-changed-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Refreshing instance network info cache due to event network-changed-697e8d57-71b4-41ea-87e0-507601444786. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] Acquiring lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] Acquired lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:10 user nova-compute[75203]: DEBUG nova.network.neutron [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Refreshing network info cache for port 697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:11 user nova-compute[75203]: DEBUG nova.network.neutron [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updated VIF entry in instance network info cache for port 697e8d57-71b4-41ea-87e0-507601444786. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:48:11 user nova-compute[75203]: DEBUG nova.network.neutron [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e452b406-bb8b-4744-8d40-48f3d378ad0c req-5147989c-1bd6-48dd-9aac-0d3c43117f5b service nova] Releasing lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Stashing vm_state: active {{(pid=75203) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:48:12 user nova-compute[75203]: INFO nova.compute.claims [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Claim successful on node user
Nov 28 18:48:12 user nova-compute[75203]: INFO nova.compute.resource_tracker [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating resource usage from migration 793e550e-426f-4963-aee1-4d856435d83b
Nov 28 18:48:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.379s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:12 user nova-compute[75203]: INFO nova.compute.manager [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Migrating
Nov 28 18:48:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquired lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-changed-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Refreshing instance network info cache due to event network-changed-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] Acquiring lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating instance_info_cache with network_info: [{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Releasing lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] Acquired lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Refreshing network info cache for port 0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Starting migrate_disk_and_power_off {{(pid=75203) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-134bce5d-46be-4d9f-bea3-d3546edd96d5 req-e632b99f-ed81-4e2b-a330-3707f6fb59d2 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-unplugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-134bce5d-46be-4d9f-bea3-d3546edd96d5 req-e632b99f-ed81-4e2b-a330-3707f6fb59d2 service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-134bce5d-46be-4d9f-bea3-d3546edd96d5 req-e632b99f-ed81-4e2b-a330-3707f6fb59d2 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-134bce5d-46be-4d9f-bea3-d3546edd96d5 req-e632b99f-ed81-4e2b-a330-3707f6fb59d2 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-134bce5d-46be-4d9f-bea3-d3546edd96d5 req-e632b99f-ed81-4e2b-a330-3707f6fb59d2 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-unplugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:13 user nova-compute[75203]: WARNING nova.compute.manager [req-134bce5d-46be-4d9f-bea3-d3546edd96d5 req-e632b99f-ed81-4e2b-a330-3707f6fb59d2 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received unexpected event network-vif-unplugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with vm_state active and task_state resize_migrating.
Nov 28 18:48:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updated VIF entry in instance network info cache for port 0ef728cc-e4b3-4167-a71c-5f4e2b1a9663. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating instance_info_cache with network_info: [{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-019984ec-d02f-4e0b-b627-f203d2762071 req-7bdbfc91-be0d-4c84-a69b-d4c163e56714 service nova] Releasing lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:14 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance destroyed successfully.
Nov 28 18:48:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405371006',display_name='tempest-ServerActionsTestOtherA-server-1405371006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405371006',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:46:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvxg74h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=cf87ffa2-f1e7-49c1-8b09-51a5d080b652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85259579-network", "vif_mac": "fa:16:3e:95:b6:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85259579-network", "vif_mac": "fa:16:3e:95:b6:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_vif [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ef728cc-e4, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=714eae86-372a-48ef-9ec7-384f4011d513) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:14 user nova-compute[75203]: INFO os_vif [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4')
Nov 28 18:48:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:48:14 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf38325-a00b-4584-88ff-47ab9e828fa5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:48:14 user nova-compute[75203]: No targets found.
Nov 28 18:48:14 user nova-compute[75203]: iSNS:
Nov 28 18:48:14 user nova-compute[75203]: No targets found.
Nov 28 18:48:14 user nova-compute[75203]: STATIC:
Nov 28 18:48:14 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:48:14 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:14 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:14 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:48:14 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:14 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:14 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:48:14 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:14 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:14 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469
Nov 28 18:48:14 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:14 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:14 user nova-compute[75203]: FIRMWARE:
Nov 28 18:48:14 user nova-compute[75203]: No targets found.
Nov 28 18:48:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:48:14 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:48:14 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55bd6e-80d4-4560-bac7-e410935f18c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[781361d0-00e2-4d73-bd5d-dfbbed196a7b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:14 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:14 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:14 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:48:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:14 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:14 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:14 user nova-compute[75203]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:48:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f076c74c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469'): ({'sdf'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Removing single pathed devices sdf {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec3a06c-d137-4663-bb01-570640c34364]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7db7cf-0456-4457-83b0-5ec75cca2600]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flushing IO for device /dev/sdf {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b3e26-0368-4a19-9646-86614d37aff7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c57d39-ed3d-46a2-8e76-5e70635360c8]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] SCSI volumes sdf have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObff91e4d-b3d2f31b28b2215e', '/dev/disk/by-id/scsi-26233643266333162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bff91e4d') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a76d56-3d30-45d7-abec-a5222876e464]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e672aebc-f78e-454f-bcb6-91a37f54d9ab]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49fbd15-6269-4c03-9e0d-5d63f8d6e2c6]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]
Nov 28 18:48:14 user nova-compute[75203]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.
Nov 28 18:48:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a505247-0564-499c-a7f3-f732b77b0707]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== disconnect_volume: return (311ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:48:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Port 0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 binding to destination host user is already ACTIVE {{(pid=75203) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquired lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-766fcbf2-04e1-45b9-904f-46c3964be3ce req-192fb42d-fd48-4bbe-8ae8-8afe5eae1421 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-766fcbf2-04e1-45b9-904f-46c3964be3ce req-192fb42d-fd48-4bbe-8ae8-8afe5eae1421 service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-766fcbf2-04e1-45b9-904f-46c3964be3ce req-192fb42d-fd48-4bbe-8ae8-8afe5eae1421 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-766fcbf2-04e1-45b9-904f-46c3964be3ce req-192fb42d-fd48-4bbe-8ae8-8afe5eae1421 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-766fcbf2-04e1-45b9-904f-46c3964be3ce req-192fb42d-fd48-4bbe-8ae8-8afe5eae1421 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:15 user nova-compute[75203]: WARNING nova.compute.manager [req-766fcbf2-04e1-45b9-904f-46c3964be3ce req-192fb42d-fd48-4bbe-8ae8-8afe5eae1421 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received unexpected event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with vm_state active and task_state resize_migrated.
Nov 28 18:48:16 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating instance_info_cache with network_info: [{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Releasing lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG os_brick.utils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7e52b5-f85e-4326-a81f-dfb9dd8d346e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a658ae-5a87-4596-b88c-8f407ed2d3ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6670b03c-9d58-4591-887b-f6db9390e7b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a249c-9241-454d-8705-25721937ff8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:48:16 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:48:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2962f6-bfde-4710-a396-4d678bbc41fc]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:48:16 user nova-compute[75203]: DEBUG os_brick.utils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:48:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Starting finish_migration {{(pid=75203) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:48:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Creating image(s)
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Ensure instance console log exists: /opt/stack/data/nova/instances/cf87ffa2-f1e7-49c1-8b09-51a5d080b652/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Start _get_guest_xml network_info=[{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85259579-network", "vif_mac": "fa:16:3e:95:b6:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cf87ffa2-f1e7-49c1-8b09-51a5d080b652', 'attached_at': '2023-11-28T18:48:24.000000', 'detached_at': '', 'volume_id': '9b67fbfb-6046-411b-a722-dc8ec2537469', 'serial': '9b67fbfb-6046-411b-a722-dc8ec2537469'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '538a98d0-aa43-48df-9d79-2b7e84995e90', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:48:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:48:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:48:23 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:48:23 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:48:23 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e29078-6258-429a-b93b-ed74ab2d76c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:48:23 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d6a32-1602-4c27-995e-27395453bba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469] added
Nov 28 18:48:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14bd7cb-67ca-4bfd-8dfa-90e131d8ff36]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f7e16-b265-40a6-9464-0c1ef43bf4b9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRkOCZbs {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRkOCZbs" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d0bd4b-0c99-4dbe-a14c-0a2e6bd944e8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRkOCZbs'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[95767aa5-3155-4a77-b9e4-2679a1264d7f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edefe98-be19-4f5d-a295-d7f6850b856b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:23 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:23 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:23 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:23 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d225e008-8861-4b3c-843a-77bf152e08ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]
Nov 28 18:48:23 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.
Nov 28 18:48:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c2334-6c5d-4e8a-bd99-b3c6e1c0e3c8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a36381-bf8f-42bc-8444-53237888e430]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:24 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:24 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:24 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:48:24 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:24 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:24 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:24 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:48:24 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf53598-38d5-4159-be4d-4f554aa581ac]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:48:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26233643266333162', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233643266333162', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405371006',display_name='tempest-ServerActionsTestOtherA-server-1405371006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405371006',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:46:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvxg74h9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=cf87ffa2-f1e7-49c1-8b09-51a5d080b652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85259579-network", "vif_mac": "fa:16:3e:95:b6:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85259579-network", "vif_mac": "fa:16:3e:95:b6:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:48:25 user nova-compute[75203]:   <uuid>cf87ffa2-f1e7-49c1-8b09-51a5d080b652</uuid>
Nov 28 18:48:25 user nova-compute[75203]:   <name>instance-00000019</name>
Nov 28 18:48:25 user nova-compute[75203]:   <memory>2097152</memory>
Nov 28 18:48:25 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:48:25 user nova-compute[75203]:   <metadata>
Nov 28 18:48:25 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:48:25 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:48:25 user nova-compute[75203]:       <nova:name>tempest-ServerActionsTestOtherA-server-1405371006</nova:name>
Nov 28 18:48:25 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:48:23</nova:creationTime>
Nov 28 18:48:25 user nova-compute[75203]:       <nova:flavor name="m1.small">
Nov 28 18:48:25 user nova-compute[75203]:         <nova:memory>2048</nova:memory>
Nov 28 18:48:25 user nova-compute[75203]:         <nova:disk>20</nova:disk>
Nov 28 18:48:25 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:48:25 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:48:25 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:48:25 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:48:25 user nova-compute[75203]:       <nova:owner>
Nov 28 18:48:25 user nova-compute[75203]:         <nova:user uuid="4b7ea4623ff14b2ea244c31ac84dd600">tempest-ServerActionsTestOtherA-1893596751-project-member</nova:user>
Nov 28 18:48:25 user nova-compute[75203]:         <nova:project uuid="974923cb2e06473bbd8e4122888494df">tempest-ServerActionsTestOtherA-1893596751</nova:project>
Nov 28 18:48:25 user nova-compute[75203]:       </nova:owner>
Nov 28 18:48:25 user nova-compute[75203]:       <nova:ports>
Nov 28 18:48:25 user nova-compute[75203]:         <nova:port uuid="0ef728cc-e4b3-4167-a71c-5f4e2b1a9663">
Nov 28 18:48:25 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 18:48:25 user nova-compute[75203]:         </nova:port>
Nov 28 18:48:25 user nova-compute[75203]:       </nova:ports>
Nov 28 18:48:25 user nova-compute[75203]:     </nova:instance>
Nov 28 18:48:25 user nova-compute[75203]:   </metadata>
Nov 28 18:48:25 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:48:25 user nova-compute[75203]:     <system>
Nov 28 18:48:25 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:48:25 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:48:25 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:48:25 user nova-compute[75203]:       <entry name="serial">cf87ffa2-f1e7-49c1-8b09-51a5d080b652</entry>
Nov 28 18:48:25 user nova-compute[75203]:       <entry name="uuid">cf87ffa2-f1e7-49c1-8b09-51a5d080b652</entry>
Nov 28 18:48:25 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:48:25 user nova-compute[75203]:     </system>
Nov 28 18:48:25 user nova-compute[75203]:   </sysinfo>
Nov 28 18:48:25 user nova-compute[75203]:   <os>
Nov 28 18:48:25 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:48:25 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:48:25 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:48:25 user nova-compute[75203]:   </os>
Nov 28 18:48:25 user nova-compute[75203]:   <features>
Nov 28 18:48:25 user nova-compute[75203]:     <acpi/>
Nov 28 18:48:25 user nova-compute[75203]:     <apic/>
Nov 28 18:48:25 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:48:25 user nova-compute[75203]:   </features>
Nov 28 18:48:25 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:48:25 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:48:25 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:48:25 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:48:25 user nova-compute[75203]:   </clock>
Nov 28 18:48:25 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:48:25 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:48:25 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:48:25 user nova-compute[75203]:   </cpu>
Nov 28 18:48:25 user nova-compute[75203]:   <devices>
Nov 28 18:48:25 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:48:25 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:48:25 user nova-compute[75203]:       <source dev="/dev/sdd"/>
Nov 28 18:48:25 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:48:25 user nova-compute[75203]:       <serial>9b67fbfb-6046-411b-a722-dc8ec2537469</serial>
Nov 28 18:48:25 user nova-compute[75203]:     </disk>
Nov 28 18:48:25 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:48:25 user nova-compute[75203]:       <mac address="fa:16:3e:95:b6:00"/>
Nov 28 18:48:25 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:48:25 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:48:25 user nova-compute[75203]:       <target dev="tap0ef728cc-e4"/>
Nov 28 18:48:25 user nova-compute[75203]:     </interface>
Nov 28 18:48:25 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:48:25 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/cf87ffa2-f1e7-49c1-8b09-51a5d080b652/console.log" append="off"/>
Nov 28 18:48:25 user nova-compute[75203]:     </serial>
Nov 28 18:48:25 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:48:25 user nova-compute[75203]:     <video>
Nov 28 18:48:25 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:48:25 user nova-compute[75203]:     </video>
Nov 28 18:48:25 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:48:25 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:48:25 user nova-compute[75203]:     </rng>
Nov 28 18:48:25 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:48:25 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:48:25 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:48:25 user nova-compute[75203]:     </memballoon>
Nov 28 18:48:25 user nova-compute[75203]:   </devices>
Nov 28 18:48:25 user nova-compute[75203]: </domain>
Nov 28 18:48:25 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405371006',display_name='tempest-ServerActionsTestOtherA-server-1405371006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405371006',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:46:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvxg74h9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=cf87ffa2-f1e7-49c1-8b09-51a5d080b652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85259579-network", "vif_mac": "fa:16:3e:95:b6:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-85259579-network", "vif_mac": "fa:16:3e:95:b6:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG os_vif [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e200294b-51fe-5d28-b4d1-860ab6af56fe', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ef728cc-e4, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ef728cc-e4, col_values=(('qos', UUID('bfe3a99e-af8f-4966-a9ed-5edfe5cf2bcd')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ef728cc-e4, col_values=(('external_ids', {'iface-id': '0ef728cc-e4b3-4167-a71c-5f4e2b1a9663', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:b6:00', 'vm-uuid': 'cf87ffa2-f1e7-49c1-8b09-51a5d080b652'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:25 user nova-compute[75203]: INFO os_vif [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4')
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] No VIF found with MAC fa:16:3e:95:b6:00, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Acquiring lock "ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Lock "ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:25 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:48:25 user nova-compute[75203]: INFO nova.compute.claims [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Claim successful on node user
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:48:26 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:48:26 user nova-compute[75203]: INFO nova.virt.block_device [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Booting with volume 86eb50de-2d33-4a99-a026-10833721e4b9 at /dev/vda
Nov 28 18:48:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG os_brick.utils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93942fa-2871-44cc-877d-e520d0ba4c4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.policy [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03ce2d042bfc474592f30094737fa2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8cb4d3394a5452b8ef5c9485a0882fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d58e8be-a91f-448e-8720-55dba8c09ec6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c469fbd3-3866-4e17-9b5f-95e3ffc60575]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd05d597-34bd-408a-a1ec-fa88b7489e71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:48:26 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9670160e-ad19-49a9-a720-9fe6be55864f]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG os_brick.utils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating existing volume attachment record: 40833883-566f-44c6-b4a3-22fc18b4dda4 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-511e0f20-b602-4649-91b4-6985b6b17e33 req-3e34a31c-05a6-4dc5-a01e-4f113ce02d1f service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-511e0f20-b602-4649-91b4-6985b6b17e33 req-3e34a31c-05a6-4dc5-a01e-4f113ce02d1f service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-511e0f20-b602-4649-91b4-6985b6b17e33 req-3e34a31c-05a6-4dc5-a01e-4f113ce02d1f service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-511e0f20-b602-4649-91b4-6985b6b17e33 req-3e34a31c-05a6-4dc5-a01e-4f113ce02d1f service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-511e0f20-b602-4649-91b4-6985b6b17e33 req-3e34a31c-05a6-4dc5-a01e-4f113ce02d1f service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:26 user nova-compute[75203]: WARNING nova.compute.manager [req-511e0f20-b602-4649-91b4-6985b6b17e33 req-3e34a31c-05a6-4dc5-a01e-4f113ce02d1f service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received unexpected event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with vm_state active and task_state resize_finish.
Nov 28 18:48:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully created port: e496f49d-e82f-40c5-a278-75ed3e4f8c59 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:48:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully created port: 21888267-81fe-4d83-b7ab-c3adfbd7c26d {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully created port: 122e104b-7d2c-4da8-b3d3-b26d0f683122 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:48:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance running successfully.
Nov 28 18:48:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Failed to set time: agent not configured {{(pid=75203) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9bb5c9ce-aa62-4836-9baa-993ad5d21be1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] finish_migration finished successfully. {{(pid=75203) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-b8b057e4-50cb-487f-b494-6ca7a56b2593 req-e38a1ab8-2c89-48ec-a591-d102b06057c8 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b8b057e4-50cb-487f-b494-6ca7a56b2593 req-e38a1ab8-2c89-48ec-a591-d102b06057c8 service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b8b057e4-50cb-487f-b494-6ca7a56b2593 req-e38a1ab8-2c89-48ec-a591-d102b06057c8 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b8b057e4-50cb-487f-b494-6ca7a56b2593 req-e38a1ab8-2c89-48ec-a591-d102b06057c8 service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-b8b057e4-50cb-487f-b494-6ca7a56b2593 req-e38a1ab8-2c89-48ec-a591-d102b06057c8 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:28 user nova-compute[75203]: WARNING nova.compute.manager [req-b8b057e4-50cb-487f-b494-6ca7a56b2593 req-e38a1ab8-2c89-48ec-a591-d102b06057c8 service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received unexpected event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with vm_state active and task_state resize_finish.
Nov 28 18:48:29 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully created port: 261f4201-3c84-4873-ba34-47a69a49fd76 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:48:29 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully created port: 4525381b-2422-4583-927a-fa5c4fa41719 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully updated port: e496f49d-e82f-40c5-a278-75ed3e4f8c59 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Received event network-changed-e496f49d-e82f-40c5-a278-75ed3e4f8c59 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing instance network info cache due to event network-changed-e496f49d-e82f-40c5-a278-75ed3e4f8c59. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing network info cache for port e496f49d-e82f-40c5-a278-75ed3e4f8c59 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e196c0-0cb3-4663-a70e-477b625ec978 req-66321e57-a5c9-41d1-abb2-46b25f7717d0 service nova] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:31 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully updated port: decb5cca-2eaa-4466-9a8e-4bf8744712cd {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG nova.compute.manager [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Received event network-changed-decb5cca-2eaa-4466-9a8e-4bf8744712cd {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG nova.compute.manager [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing instance network info cache due to event network-changed-decb5cca-2eaa-4466-9a8e-4bf8744712cd. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG nova.network.neutron [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing network info cache for port decb5cca-2eaa-4466-9a8e-4bf8744712cd {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully updated port: 9f9ae3bb-a445-410d-9dd1-e43ea5f061c4 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG nova.network.neutron [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:48:32 user nova-compute[75203]: DEBUG nova.network.neutron [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4d1d0ce9-3d81-4aa8-b71f-42edf52d2907 req-01eec671-e28d-4f71-8d14-533c769f8444 service nova] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully updated port: 21888267-81fe-4d83-b7ab-c3adfbd7c26d {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:48:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Received event network-changed-9f9ae3bb-a445-410d-9dd1-e43ea5f061c4 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing instance network info cache due to event network-changed-9f9ae3bb-a445-410d-9dd1-e43ea5f061c4. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing network info cache for port 9f9ae3bb-a445-410d-9dd1-e43ea5f061c4 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:48:35 user nova-compute[75203]: INFO nova.virt.block_device [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Booting with volume d74d2f64-dcc2-450c-8b76-19bf50077442 at /dev/vdb
Nov 28 18:48:35 user nova-compute[75203]: DEBUG os_brick.utils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[440da875-834c-470c-9b38-b8c1aa91ffde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[add6dcfc-6158-47ab-a26d-00d5dc39a0ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12cf67-c750-4e89-a628-1e7d670a72d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[657328d6-b012-462e-88a6-01c6ba411965]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Received event network-changed-21888267-81fe-4d83-b7ab-c3adfbd7c26d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing instance network info cache due to event network-changed-21888267-81fe-4d83-b7ab-c3adfbd7c26d. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing network info cache for port 21888267-81fe-4d83-b7ab-c3adfbd7c26d {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:48:35 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9464799d-9558-4100-8c77-741d70cde4c2]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG os_brick.utils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating existing volume attachment record: 44ed020f-4c76-4d01-80d7-3945bfd3bad5 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully updated port: 122e104b-7d2c-4da8-b3d3-b26d0f683122 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-70f9a813-41c0-486c-b057-ae9bcd183c2a req-deec71e7-e1cf-4b1f-bd70-b4f0dbb07786 service nova] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:36 user nova-compute[75203]: INFO nova.compute.manager [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Terminating instance
Nov 28 18:48:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Received event network-changed-122e104b-7d2c-4da8-b3d3-b26d0f683122 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing instance network info cache due to event network-changed-122e104b-7d2c-4da8-b3d3-b26d0f683122. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG nova.network.neutron [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing network info cache for port 122e104b-7d2c-4da8-b3d3-b26d0f683122 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG nova.network.neutron [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-c10c51fc-0673-4d09-a073-12352b91e7b7 req-859a48fd-294b-4c47-9a3f-6350f6909eb7 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c10c51fc-0673-4d09-a073-12352b91e7b7 req-859a48fd-294b-4c47-9a3f-6350f6909eb7 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c10c51fc-0673-4d09-a073-12352b91e7b7 req-859a48fd-294b-4c47-9a3f-6350f6909eb7 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c10c51fc-0673-4d09-a073-12352b91e7b7 req-859a48fd-294b-4c47-9a3f-6350f6909eb7 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-c10c51fc-0673-4d09-a073-12352b91e7b7 req-859a48fd-294b-4c47-9a3f-6350f6909eb7 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-c10c51fc-0673-4d09-a073-12352b91e7b7 req-859a48fd-294b-4c47-9a3f-6350f6909eb7 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully updated port: 261f4201-3c84-4873-ba34-47a69a49fd76 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Instance destroyed successfully.
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.objects.instance [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lazy-loading 'resources' on Instance uuid 449f7a33-7a5a-4618-b840-59039ed50492 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-937811796',display_name='tempest-ServerActionsTestOtherB-server-937811796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-937811796',id=18,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8PexDRN4lPfNvSLhXsoHkfwPEB81iNpGGoTjCknzaauUXUwCrEkK8uG4pSQzN6tEscn39VJMg3/Zwi2nUULdeTQxWijy0MODSnwBUdRjCaKYSIIGTYxWbBZKoRDcsq0w==',key_name='tempest-keypair-1153230850',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:46:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c45c2671f2344fc93f3f578c8ebf0f0',ramdisk_id='',reservation_id='r-s7diwdob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1400740793',owner_user_name='tempest-ServerActionsTestOtherB-1400740793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6695b6171894c0ab01d4f5e64af03ba',uuid=449f7a33-7a5a-4618-b840-59039ed50492,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converting VIF {"id": "51986925-f22e-4528-b519-836232111180", "address": "fa:16:3e:7e:8f:c7", "network": {"id": "7f5f31c6-c6e8-43a1-8e91-6750d7f6559d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-97127879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c45c2671f2344fc93f3f578c8ebf0f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51986925-f2", "ovs_interfaceid": "51986925-f22e-4528-b519-836232111180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_vif [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51986925-f2, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9510bfdd-68d8-42b6-840e-eb79b65e3a46) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:37 user nova-compute[75203]: INFO os_vif [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8f:c7,bridge_name='br-int',has_traffic_filtering=True,id=51986925-f22e-4528-b519-836232111180,network=Network(7f5f31c6-c6e8-43a1-8e91-6750d7f6559d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51986925-f2')
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVYPrlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:48:37 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe5829e-3e17-4c06-85b0-e71194b5850e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:48:37 user nova-compute[75203]: No targets found.
Nov 28 18:48:37 user nova-compute[75203]: iSNS:
Nov 28 18:48:37 user nova-compute[75203]: No targets found.
Nov 28 18:48:37 user nova-compute[75203]: STATIC:
Nov 28 18:48:37 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:48:37 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:37 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:37 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:48:37 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:37 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:37 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b
Nov 28 18:48:37 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:37 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:37 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469
Nov 28 18:48:37 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:48:37 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:48:37 user nova-compute[75203]: FIRMWARE:
Nov 28 18:48:37 user nova-compute[75203]: No targets found.
Nov 28 18:48:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:48:37 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:48:37 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce969aef-713b-463f-acbc-08276b79c7ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0a2477-e935-420d-80cc-fb24df0d67ff]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:37 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:37 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:37 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:48:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:48:37 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:48:37 user nova-compute[75203]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b (non-flash)
Nov 28 18:48:37 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:48:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07901888b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.network.neutron [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5170713c-991e-46a6-9430-55eadd58d043]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0cd3bbbf-833d-49cc-8142-bab7b02c3878 req-f5921cc2-f474-4d44-b0cd-9b9aebfe9b81 service nova] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ac92b-1716-4313-b885-dbd77a714865]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ecca4a-dc51-44d5-a7df-acb6c7bf1ca2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f25496-2ba5-4afa-96d4-20caf2888823]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[00620ebb-5d49-46d7-a66c-455784ff06e4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df59d01-813b-473a-9179-9494d99d64f6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260]
Nov 28 18:48:37 user nova-compute[75203]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b, portal: 172.16.0.220,3260] successful.
Nov 28 18:48:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8edef2a2-3c2d-4a41-993e-f47d082e848b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3361e3de-75bd-4bca-87d9-326fa28f3272]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] <== disconnect_volume: return (413ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:48:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:48:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Deleting instance files /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492_del
Nov 28 18:48:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Deletion of /opt/stack/data/nova/instances/449f7a33-7a5a-4618-b840-59039ed50492_del complete
Nov 28 18:48:38 user nova-compute[75203]: INFO nova.compute.manager [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 28 18:48:38 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Successfully updated port: 4525381b-2422-4583-927a-fa5c4fa41719 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Received event network-changed-261f4201-3c84-4873-ba34-47a69a49fd76 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing instance network info cache due to event network-changed-261f4201-3c84-4873-ba34-47a69a49fd76. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:39 user nova-compute[75203]: WARNING nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state deleting.
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:39 user nova-compute[75203]: WARNING nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state deleting.
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:39 user nova-compute[75203]: WARNING nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state deleting.
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-unplugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-unplugged-51986925-f22e-4528-b519-836232111180 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Acquiring lock "449f7a33-7a5a-4618-b840-59039ed50492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] Lock "449f7a33-7a5a-4618-b840-59039ed50492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] No waiting events found dispatching network-vif-plugged-51986925-f22e-4528-b519-836232111180 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:39 user nova-compute[75203]: WARNING nova.compute.manager [req-543f0713-f9d1-4102-ad89-79f739f6e769 req-2b98b849-ecf8-4907-9a52-83f978847fa0 service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received unexpected event network-vif-plugged-51986925-f22e-4528-b519-836232111180 for instance with vm_state active and task_state deleting.
Nov 28 18:48:39 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:39 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Took 1.52 seconds to deallocate network for instance.
Nov 28 18:48:40 user nova-compute[75203]: INFO nova.compute.manager [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Unrescuing
Nov 28 18:48:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:40 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:48:40 user nova-compute[75203]: INFO nova.compute.manager [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Took 0.82 seconds to detach 1 volumes for instance.
Nov 28 18:48:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.volume.cinder [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Update attachment failed for attachment 44ed020f-4c76-4d01-80d7-3945bfd3bad5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-43386c0b-45a6-4dc2-9328-7f7d1086978a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-43386c0b-45a6-4dc2-9328-7f7d1086978a)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-43386c0b-45a6-4dc2-9328-7f7d1086978a)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Traceback (most recent call last):
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     driver_block_device.attach_block_devices(
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     _log_and_attach(device)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     bdm.attach(*attach_args, **attach_kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     ret_val = method(obj, context, *args, **kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     self._do_attach(context, instance, volume, volume_api,
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     self._volume_attach(context, volume, connector, instance,
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     connection_info = volume_api.attachment_update(
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     res = method(self, ctx, *args, **kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     with excutils.save_and_reraise_exception():
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     self.force_reraise()
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     raise self.value
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     return method.func(obj, *args, **kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     resp = self._update('/attachments/%s' % id, body)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     return self.request(url, method, **kwargs)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2]     raise exceptions.from_response(resp, body)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-43386c0b-45a6-4dc2-9328-7f7d1086978a)
Nov 28 18:48:40 user nova-compute[75203]: ERROR nova.compute.manager [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] 
Nov 28 18:48:40 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:48:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-6e49f194-4f62-4c38-b4ee-de3ae212f1fc req-b53263bf-5807-4732-aa7a-2906b6c8414d service nova] [instance: 449f7a33-7a5a-4618-b840-59039ed50492] Received event network-vif-deleted-51986925-f22e-4528-b519-836232111180 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:40 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:48:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:40 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Deleted allocations for instance 449f7a33-7a5a-4618-b840-59039ed50492
Nov 28 18:48:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-aa8deffb-c423-41f9-9da4-9f7b1d0557f0 tempest-ServerActionsTestOtherB-1400740793 tempest-ServerActionsTestOtherB-1400740793-project-member] Lock "449f7a33-7a5a-4618-b840-59039ed50492" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.402s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:41 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating instance_info_cache with network_info: [{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:41 user nova-compute[75203]: DEBUG nova.objects.instance [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'flavor' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:48:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance destroyed successfully.
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [{"id": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "address": "fa:16:3e:46:e0:13", "network": {"id": "8f680b9d-9d7a-4635-8e3f-2790c5bcb607", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1280903643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape496f49d-e8", "ovs_interfaceid": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "address": "fa:16:3e:e7:4e:cc", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecb5cca-2e", "ovs_interfaceid": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "address": "fa:16:3e:3c:c5:f8", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9ae3bb-a4", "ovs_interfaceid": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "address": "fa:16:3e:4d:e6:81", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21888267-81", "ovs_interfaceid": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "address": "fa:16:3e:57:22:a9", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap122e104b-7d", "ovs_interfaceid": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "261f4201-3c84-4873-ba34-47a69a49fd76", "address": "fa:16:3e:17:dd:2b", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261f4201-3c", "ovs_interfaceid": "261f4201-3c84-4873-ba34-47a69a49fd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4525381b-2422-4583-927a-fa5c4fa41719", "address": "fa:16:3e:2b:e9:36", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4525381b-24", "ovs_interfaceid": "4525381b-2422-4583-927a-fa5c4fa41719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Instance network_info: |[{"id": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "address": "fa:16:3e:46:e0:13", "network": {"id": "8f680b9d-9d7a-4635-8e3f-2790c5bcb607", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1280903643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape496f49d-e8", "ovs_interfaceid": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "address": "fa:16:3e:e7:4e:cc", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecb5cca-2e", "ovs_interfaceid": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "address": "fa:16:3e:3c:c5:f8", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9ae3bb-a4", "ovs_interfaceid": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "address": "fa:16:3e:4d:e6:81", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21888267-81", "ovs_interfaceid": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "address": "fa:16:3e:57:22:a9", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap122e104b-7d", "ovs_interfaceid": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "261f4201-3c84-4873-ba34-47a69a49fd76", "address": "fa:16:3e:17:dd:2b", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261f4201-3c", "ovs_interfaceid": "261f4201-3c84-4873-ba34-47a69a49fd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4525381b-2422-4583-927a-fa5c4fa41719", "address": "fa:16:3e:2b:e9:36", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4525381b-24", "ovs_interfaceid": "4525381b-2422-4583-927a-fa5c4fa41719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing network info cache for port 261f4201-3c84-4873-ba34-47a69a49fd76 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.claims [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Aborting claim: <nova.compute.claims.Claim object at 0x7f07a0245fc0> {{(pid=75203) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updated VIF entry in instance network info cache for port 261f4201-3c84-4873-ba34-47a69a49fd76. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [{"id": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "address": "fa:16:3e:46:e0:13", "network": {"id": "8f680b9d-9d7a-4635-8e3f-2790c5bcb607", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1280903643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape496f49d-e8", "ovs_interfaceid": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "address": "fa:16:3e:e7:4e:cc", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecb5cca-2e", "ovs_interfaceid": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "address": "fa:16:3e:3c:c5:f8", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9ae3bb-a4", "ovs_interfaceid": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "address": "fa:16:3e:4d:e6:81", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21888267-81", "ovs_interfaceid": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "address": "fa:16:3e:57:22:a9", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap122e104b-7d", "ovs_interfaceid": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "261f4201-3c84-4873-ba34-47a69a49fd76", "address": "fa:16:3e:17:dd:2b", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261f4201-3c", "ovs_interfaceid": "261f4201-3c84-4873-ba34-47a69a49fd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4525381b-2422-4583-927a-fa5c4fa41719", "address": "fa:16:3e:2b:e9:36", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4525381b-24", "ovs_interfaceid": "4525381b-2422-4583-927a-fa5c4fa41719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Received event network-changed-4525381b-2422-4583-927a-fa5c4fa41719 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing instance network info cache due to event network-changed-4525381b-2422-4583-927a-fa5c4fa41719. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] Acquiring lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] Acquired lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Refreshing network info cache for port 4525381b-2422-4583-927a-fa5c4fa41719 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.514s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Build of instance ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-43386c0b-45a6-4dc2-9328-7f7d1086978a) {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.utils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Build of instance ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75203) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 28 18:48:42 user nova-compute[75203]: ERROR nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Build of instance ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-43386c0b-45a6-4dc2-9328-7f7d1086978a): nova.exception.BuildAbortException: Build of instance ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-43386c0b-45a6-4dc2-9328-7f7d1086978a)
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Unplugging VIFs for instance {{(pid=75203) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614260227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614260227',id=27,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOEOAfj9a91rDzYfdFB0odt+r1GCiNtx0vtbiXKfSldhCHQGvdUMjdqziXxkaDvh8b+kQ9WFG0ST74136VJQcHOD2Kz5R8mbvbH/8b44Es+jfBHivqAqY2Oy4Ajk193aA==',key_name='tempest-keypair-509215878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8cb4d3394a5452b8ef5c9485a0882fb',ramdisk_id='',reservation_id='r-1xe1sz77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1504785286',owner_user_name='tempest-TaggedBootDevicesTest_v242-1504785286-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ce2d042bfc474592f30094737fa2ef',uuid=ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "address": "fa:16:3e:46:e0:13", "network": {"id": "8f680b9d-9d7a-4635-8e3f-2790c5bcb607", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1280903643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape496f49d-e8", "ovs_interfaceid": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converting VIF {"id": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "address": "fa:16:3e:46:e0:13", "network": {"id": "8f680b9d-9d7a-4635-8e3f-2790c5bcb607", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1280903643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape496f49d-e8", "ovs_interfaceid": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e0:13,bridge_name='br-int',has_traffic_filtering=True,id=e496f49d-e82f-40c5-a278-75ed3e4f8c59,network=Network(8f680b9d-9d7a-4635-8e3f-2790c5bcb607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape496f49d-e8') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e0:13,bridge_name='br-int',has_traffic_filtering=True,id=e496f49d-e82f-40c5-a278-75ed3e4f8c59,network=Network(8f680b9d-9d7a-4635-8e3f-2790c5bcb607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape496f49d-e8') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape496f49d-e8, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:42 user nova-compute[75203]: INFO os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e0:13,bridge_name='br-int',has_traffic_filtering=True,id=e496f49d-e82f-40c5-a278-75ed3e4f8c59,network=Network(8f680b9d-9d7a-4635-8e3f-2790c5bcb607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape496f49d-e8')
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614260227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614260227',id=27,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOEOAfj9a91rDzYfdFB0odt+r1GCiNtx0vtbiXKfSldhCHQGvdUMjdqziXxkaDvh8b+kQ9WFG0ST74136VJQcHOD2Kz5R8mbvbH/8b44Es+jfBHivqAqY2Oy4Ajk193aA==',key_name='tempest-keypair-509215878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8cb4d3394a5452b8ef5c9485a0882fb',ramdisk_id='',reservation_id='r-1xe1sz77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1504785286',owner_user_name='tempest-TaggedBootDevicesTest_v242-1504785286-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ce2d042bfc474592f30094737fa2ef',uuid=ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "address": "fa:16:3e:e7:4e:cc", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecb5cca-2e", "ovs_interfaceid": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converting VIF {"id": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "address": "fa:16:3e:e7:4e:cc", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecb5cca-2e", "ovs_interfaceid": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:4e:cc,bridge_name='br-int',has_traffic_filtering=True,id=decb5cca-2eaa-4466-9a8e-4bf8744712cd,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecb5cca-2e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:4e:cc,bridge_name='br-int',has_traffic_filtering=True,id=decb5cca-2eaa-4466-9a8e-4bf8744712cd,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecb5cca-2e') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdecb5cca-2e, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:42 user nova-compute[75203]: INFO os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:4e:cc,bridge_name='br-int',has_traffic_filtering=True,id=decb5cca-2eaa-4466-9a8e-4bf8744712cd,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecb5cca-2e')
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614260227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614260227',id=27,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOEOAfj9a91rDzYfdFB0odt+r1GCiNtx0vtbiXKfSldhCHQGvdUMjdqziXxkaDvh8b+kQ9WFG0ST74136VJQcHOD2Kz5R8mbvbH/8b44Es+jfBHivqAqY2Oy4Ajk193aA==',key_name='tempest-keypair-509215878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8cb4d3394a5452b8ef5c9485a0882fb',ramdisk_id='',reservation_id='r-1xe1sz77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1504785286',owner_user_name='tempest-TaggedBootDevicesTest_v242-1504785286-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ce2d042bfc474592f30094737fa2ef',uuid=ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "address": "fa:16:3e:3c:c5:f8", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9ae3bb-a4", "ovs_interfaceid": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converting VIF {"id": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "address": "fa:16:3e:3c:c5:f8", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9ae3bb-a4", "ovs_interfaceid": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c5:f8,bridge_name='br-int',has_traffic_filtering=True,id=9f9ae3bb-a445-410d-9dd1-e43ea5f061c4,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f9ae3bb-a4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c5:f8,bridge_name='br-int',has_traffic_filtering=True,id=9f9ae3bb-a445-410d-9dd1-e43ea5f061c4,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f9ae3bb-a4') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f9ae3bb-a4, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:42 user nova-compute[75203]: INFO os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c5:f8,bridge_name='br-int',has_traffic_filtering=True,id=9f9ae3bb-a445-410d-9dd1-e43ea5f061c4,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f9ae3bb-a4')
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614260227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614260227',id=27,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOEOAfj9a91rDzYfdFB0odt+r1GCiNtx0vtbiXKfSldhCHQGvdUMjdqziXxkaDvh8b+kQ9WFG0ST74136VJQcHOD2Kz5R8mbvbH/8b44Es+jfBHivqAqY2Oy4Ajk193aA==',key_name='tempest-keypair-509215878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8cb4d3394a5452b8ef5c9485a0882fb',ramdisk_id='',reservation_id='r-1xe1sz77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1504785286',owner_user_name='tempest-TaggedBootDevicesTest_v242-1504785286-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ce2d042bfc474592f30094737fa2ef',uuid=ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "address": "fa:16:3e:4d:e6:81", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21888267-81", "ovs_interfaceid": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converting VIF {"id": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "address": "fa:16:3e:4d:e6:81", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21888267-81", "ovs_interfaceid": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=21888267-81fe-4d83-b7ab-c3adfbd7c26d,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21888267-81') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=21888267-81fe-4d83-b7ab-c3adfbd7c26d,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21888267-81') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21888267-81, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:42 user nova-compute[75203]: INFO os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e6:81,bridge_name='br-int',has_traffic_filtering=True,id=21888267-81fe-4d83-b7ab-c3adfbd7c26d,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21888267-81')
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614260227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614260227',id=27,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOEOAfj9a91rDzYfdFB0odt+r1GCiNtx0vtbiXKfSldhCHQGvdUMjdqziXxkaDvh8b+kQ9WFG0ST74136VJQcHOD2Kz5R8mbvbH/8b44Es+jfBHivqAqY2Oy4Ajk193aA==',key_name='tempest-keypair-509215878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8cb4d3394a5452b8ef5c9485a0882fb',ramdisk_id='',reservation_id='r-1xe1sz77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1504785286',owner_user_name='tempest-TaggedBootDevicesTest_v242-1504785286-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ce2d042bfc474592f30094737fa2ef',uuid=ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "address": "fa:16:3e:57:22:a9", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap122e104b-7d", "ovs_interfaceid": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converting VIF {"id": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "address": "fa:16:3e:57:22:a9", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap122e104b-7d", "ovs_interfaceid": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:a9,bridge_name='br-int',has_traffic_filtering=True,id=122e104b-7d2c-4da8-b3d3-b26d0f683122,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap122e104b-7d') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:a9,bridge_name='br-int',has_traffic_filtering=True,id=122e104b-7d2c-4da8-b3d3-b26d0f683122,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap122e104b-7d') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap122e104b-7d, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:42 user nova-compute[75203]: INFO os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:22:a9,bridge_name='br-int',has_traffic_filtering=True,id=122e104b-7d2c-4da8-b3d3-b26d0f683122,network=Network(019ef6d7-24f4-48a8-92ef-268b4504af0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap122e104b-7d')
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614260227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614260227',id=27,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOEOAfj9a91rDzYfdFB0odt+r1GCiNtx0vtbiXKfSldhCHQGvdUMjdqziXxkaDvh8b+kQ9WFG0ST74136VJQcHOD2Kz5R8mbvbH/8b44Es+jfBHivqAqY2Oy4Ajk193aA==',key_name='tempest-keypair-509215878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8cb4d3394a5452b8ef5c9485a0882fb',ramdisk_id='',reservation_id='r-1xe1sz77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1504785286',owner_user_name='tempest-TaggedBootDevicesTest_v242-1504785286-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ce2d042bfc474592f30094737fa2ef',uuid=ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "261f4201-3c84-4873-ba34-47a69a49fd76", "address": "fa:16:3e:17:dd:2b", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261f4201-3c", "ovs_interfaceid": "261f4201-3c84-4873-ba34-47a69a49fd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converting VIF {"id": "261f4201-3c84-4873-ba34-47a69a49fd76", "address": "fa:16:3e:17:dd:2b", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261f4201-3c", "ovs_interfaceid": "261f4201-3c84-4873-ba34-47a69a49fd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:2b,bridge_name='br-int',has_traffic_filtering=True,id=261f4201-3c84-4873-ba34-47a69a49fd76,network=Network(b3f54fc0-570d-4a53-9f37-15855992d5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261f4201-3c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:2b,bridge_name='br-int',has_traffic_filtering=True,id=261f4201-3c84-4873-ba34-47a69a49fd76,network=Network(b3f54fc0-570d-4a53-9f37-15855992d5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261f4201-3c') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap261f4201-3c, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:42 user nova-compute[75203]: INFO os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:dd:2b,bridge_name='br-int',has_traffic_filtering=True,id=261f4201-3c84-4873-ba34-47a69a49fd76,network=Network(b3f54fc0-570d-4a53-9f37-15855992d5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261f4201-3c')
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-28T18:48:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1614260227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1614260227',id=27,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOEOAfj9a91rDzYfdFB0odt+r1GCiNtx0vtbiXKfSldhCHQGvdUMjdqziXxkaDvh8b+kQ9WFG0ST74136VJQcHOD2Kz5R8mbvbH/8b44Es+jfBHivqAqY2Oy4Ajk193aA==',key_name='tempest-keypair-509215878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8cb4d3394a5452b8ef5c9485a0882fb',ramdisk_id='',reservation_id='r-1xe1sz77',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1504785286',owner_user_name='tempest-TaggedBootDevicesTest_v242-1504785286-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03ce2d042bfc474592f30094737fa2ef',uuid=ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4525381b-2422-4583-927a-fa5c4fa41719", "address": "fa:16:3e:2b:e9:36", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4525381b-24", "ovs_interfaceid": "4525381b-2422-4583-927a-fa5c4fa41719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converting VIF {"id": "4525381b-2422-4583-927a-fa5c4fa41719", "address": "fa:16:3e:2b:e9:36", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4525381b-24", "ovs_interfaceid": "4525381b-2422-4583-927a-fa5c4fa41719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:e9:36,bridge_name='br-int',has_traffic_filtering=True,id=4525381b-2422-4583-927a-fa5c4fa41719,network=Network(b3f54fc0-570d-4a53-9f37-15855992d5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4525381b-24') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:e9:36,bridge_name='br-int',has_traffic_filtering=True,id=4525381b-2422-4583-927a-fa5c4fa41719,network=Network(b3f54fc0-570d-4a53-9f37-15855992d5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4525381b-24') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4525381b-24, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:48:42 user nova-compute[75203]: INFO os_vif [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:e9:36,bridge_name='br-int',has_traffic_filtering=True,id=4525381b-2422-4583-927a-fa5c4fa41719,network=Network(b3f54fc0-570d-4a53-9f37-15855992d5a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4525381b-24')
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Unplugged VIFs for instance {{(pid=75203) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:42 user nova-compute[75203]: WARNING nova.compute.manager [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:42 user nova-compute[75203]: WARNING nova.compute.manager [req-4ae5c785-1f41-4ba5-88a1-7d18db631ac8 req-082c732d-46f1-488e-9246-939b72896f22 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:48:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:43 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updated VIF entry in instance network info cache for port 4525381b-2422-4583-927a-fa5c4fa41719. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:48:43 user nova-compute[75203]: DEBUG nova.network.neutron [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [{"id": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "address": "fa:16:3e:46:e0:13", "network": {"id": "8f680b9d-9d7a-4635-8e3f-2790c5bcb607", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1280903643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape496f49d-e8", "ovs_interfaceid": "e496f49d-e82f-40c5-a278-75ed3e4f8c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "address": "fa:16:3e:e7:4e:cc", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecb5cca-2e", "ovs_interfaceid": "decb5cca-2eaa-4466-9a8e-4bf8744712cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "address": "fa:16:3e:3c:c5:f8", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f9ae3bb-a4", "ovs_interfaceid": "9f9ae3bb-a445-410d-9dd1-e43ea5f061c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "address": "fa:16:3e:4d:e6:81", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21888267-81", "ovs_interfaceid": "21888267-81fe-4d83-b7ab-c3adfbd7c26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "address": "fa:16:3e:57:22:a9", "network": {"id": "019ef6d7-24f4-48a8-92ef-268b4504af0e", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075199655", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap122e104b-7d", "ovs_interfaceid": "122e104b-7d2c-4da8-b3d3-b26d0f683122", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "261f4201-3c84-4873-ba34-47a69a49fd76", "address": "fa:16:3e:17:dd:2b", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261f4201-3c", "ovs_interfaceid": "261f4201-3c84-4873-ba34-47a69a49fd76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4525381b-2422-4583-927a-fa5c4fa41719", "address": "fa:16:3e:2b:e9:36", "network": {"id": "b3f54fc0-570d-4a53-9f37-15855992d5a7", "bridge": "br-int", "label": "tempest-device-tagging-net2-328157636", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b8cb4d3394a5452b8ef5c9485a0882fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4525381b-24", "ovs_interfaceid": "4525381b-2422-4583-927a-fa5c4fa41719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a3e8f354-57b7-435a-bee1-9eb6801bd202 req-f10acbe7-a541-47f3-a51e-9211ab9197cc service nova] Releasing lock "refresh_cache-ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:48:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:44 user nova-compute[75203]: WARNING nova.compute.manager [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:48:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:48:44 user nova-compute[75203]: WARNING nova.compute.manager [req-affccca9-2e80-4e88-87d6-f1a45ca9c68d req-06d63546-44af-4794-8377-520bdb11c5c4 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:48:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f12cc0f-cf9c-4590-86c6-6bdff85c1b82 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:48:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:48:46 user nova-compute[75203]: INFO nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Took 3.67 seconds to deallocate network for instance.
Nov 28 18:48:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Detaching volume: 86eb50de-2d33-4a99-a026-10833721e4b9 {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 28 18:48:46 user nova-compute[75203]: INFO nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Detaching volume 86eb50de-2d33-4a99-a026-10833721e4b9
Nov 28 18:48:46 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Skipping driver_detach during remote rebuild. {{(pid=75203) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 28 18:48:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:48:47 user nova-compute[75203]: WARNING nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Failed to detach volume: 86eb50de-2d33-4a99-a026-10833721e4b9 due to 'NoneType' object has no attribute 'devices'
Nov 28 18:48:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Detaching volume: d74d2f64-dcc2-450c-8b76-19bf50077442 {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 28 18:48:47 user nova-compute[75203]: INFO nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Detaching volume d74d2f64-dcc2-450c-8b76-19bf50077442
Nov 28 18:48:47 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Skipping driver_detach during remote rebuild. {{(pid=75203) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:47 user nova-compute[75203]: WARNING nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Failed to detach volume: d74d2f64-dcc2-450c-8b76-19bf50077442 due to 'NoneType' object has no attribute 'devices'
Nov 28 18:48:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Detaching volume: d6e3ba7a-6759-4ba0-8b2d-37e9a6fb7a6f {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 28 18:48:47 user nova-compute[75203]: INFO nova.compute.manager [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Detaching volume d6e3ba7a-6759-4ba0-8b2d-37e9a6fb7a6f
Nov 28 18:48:47 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] [instance: ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2] Skipping driver_detach during remote rebuild. {{(pid=75203) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 28 18:48:47 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Deleted allocations for instance ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18c46292-0ecd-486c-b628-1301b7468318 tempest-TaggedBootDevicesTest_v242-1504785286 tempest-TaggedBootDevicesTest_v242-1504785286-project-member] Lock "ae1e8ca4-3f41-4df9-8ce0-32b03a1236f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.071s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:48:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:48:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:48:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:48:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7897MB free_disk=25.04916000366211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:48:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Applying migration context for instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 as it has an incoming, in-progress migration 793e550e-426f-4963-aee1-4d856435d83b. Migration status is finished {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 18:48:51 user nova-compute[75203]: INFO nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating resource usage from migration 793e550e-426f-4963-aee1-4d856435d83b
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 13524911-1006-4646-9c67-def22fb36ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b61c9405-587d-4b45-9641-7b1e2d73475a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Migration 793e550e-426f-4963-aee1-4d856435d83b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:48:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:48:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:48:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 18:48:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:48:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:48:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing instance network info cache due to event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:49:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] Acquiring lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] Acquired lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:02 user nova-compute[75203]: INFO nova.compute.manager [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Detaching volume 630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:49:02 user nova-compute[75203]: INFO nova.virt.block_device [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Attempting to driver detach volume 630c7d86-8370-40f1-8200-7cfe2c3045d2 from mountpoint /dev/vdb
Nov 28 18:49:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Attempting to detach device vdb from instance 13524911-1006-4646-9c67-def22fb36ac4 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:49:02 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:49:02 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:49:02 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:49:02 user nova-compute[75203]:   <serial>630c7d86-8370-40f1-8200-7cfe2c3045d2</serial>
Nov 28 18:49:02 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:49:02 user nova-compute[75203]: </disk>
Nov 28 18:49:02 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:49:02 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully detached device vdb from instance 13524911-1006-4646-9c67-def22fb36ac4 from the persistent domain config.
Nov 28 18:49:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 13524911-1006-4646-9c67-def22fb36ac4 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:49:02 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:49:02 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:49:02 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:49:02 user nova-compute[75203]:   <serial>630c7d86-8370-40f1-8200-7cfe2c3045d2</serial>
Nov 28 18:49:02 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:49:02 user nova-compute[75203]: </disk>
Nov 28 18:49:02 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updated VIF entry in instance network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-415b5676-4d41-4d71-a1d9-d39d1c135eac req-cc96229a-d3b2-45ea-bb76-98c3c63ce881 service nova] Releasing lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:49:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing instance network info cache due to event network-changed-93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:49:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] Acquiring lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] Acquired lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:03 user nova-compute[75203]: DEBUG nova.network.neutron [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Refreshing network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:49:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updated VIF entry in instance network info cache for port 93f2167d-e2f4-49cc-9a16-f423db7c60a9. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:49:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [{"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e530c9b6-76a9-4c67-b5d2-fef4dafdc926 req-b356f2f0-d95c-440a-8443-0213c6d3d0a4 service nova] Releasing lock "refresh_cache-13524911-1006-4646-9c67-def22fb36ac4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 18:49:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:49:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:49:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:22 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 13524911-1006-4646-9c67-def22fb36ac4 is timed out.
Nov 28 18:49:22 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully detached device vdb from instance 13524911-1006-4646-9c67-def22fb36ac4 from the live domain config.
Nov 28 18:49:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yESrOzMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:49:22 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[230a9671-11d2-4b60-a1a5-737551d2fe94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:49:22 user nova-compute[75203]: No targets found.
Nov 28 18:49:22 user nova-compute[75203]: iSNS:
Nov 28 18:49:22 user nova-compute[75203]: No targets found.
Nov 28 18:49:22 user nova-compute[75203]: STATIC:
Nov 28 18:49:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2
Nov 28 18:49:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:49:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:49:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:49:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:49:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:49:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469
Nov 28 18:49:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:49:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:49:22 user nova-compute[75203]: FIRMWARE:
Nov 28 18:49:22 user nova-compute[75203]: No targets found.
Nov 28 18:49:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:49:22 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:49:22 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a97ec-e2c9-4516-87cb-7990ea03ca38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[248a0f61-c51c-4d60-b0fb-a9a8b645dc60]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:49:22 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:49:22 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:49:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:49:22 user nova-compute[75203]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 (non-flash)
Nov 28 18:49:22 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:49:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a81c08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2'): ({'sde'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Removing single pathed devices sde {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f81ef8-a61f-404b-9ba4-03c2407c5b07]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d5227-578b-4400-badd-b930abc0ea7a]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Flushing IO for device /dev/sde {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4aabdc-2da4-4a09-94f5-3239f33994cb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0715e719-3212-476f-86a4-9c4de614562f]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1590f5cd-3aab-4572-8f76-3e6a9cb11fc8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[987b23f8-89ee-49ea-bc1b-50417107202d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260]
Nov 28 18:49:22 user nova-compute[75203]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2, portal: 172.16.0.220,3260] successful.
Nov 28 18:49:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:630c7d86-8370-40f1-8200-7cfe2c3045d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af722e87-d467-4321-bcee-dc61632a4216]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] <== disconnect_volume: return (326ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:49:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:49:23 user nova-compute[75203]: DEBUG nova.objects.instance [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'flavor' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:49:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a2fce6b9-e236-4483-83e0-78b030385a5a tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:49:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:49:39 user nova-compute[75203]: INFO nova.compute.claims [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Claim successful on node user
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-changed-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Refreshing instance network info cache due to event network-changed-8c469b22-5936-4e14-b8db-1eb192478239. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] Acquiring lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] Acquired lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.network.neutron [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Refreshing network info cache for port 8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.network.neutron [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:49:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.policy [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe8c1bccaa174d4da0865d55770703a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc3f94308cd4b99871d9113d6516bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:49:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Creating image(s)
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "/opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "/opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "/opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Updated VIF entry in instance network info cache for port 8c469b22-5936-4e14-b8db-1eb192478239. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Updating instance_info_cache with network_info: [{"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-aca7dc93-6da0-4d1a-a52a-3ffbebfe89e4 req-c9725ba3-dd8c-40fe-8649-2d25fd3c058f service nova] Releasing lock "refresh_cache-b61c9405-587d-4b45-9641-7b1e2d73475a" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk 1073741824" returned: 0 in 0.051s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG nova.network.neutron [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Successfully created port: 15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Cannot resize image /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Ensure instance console log exists: /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Successfully updated port: 15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquired lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-changed-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Refreshing instance network info cache due to event network-changed-15b2ad33-078c-4923-9d9d-6eb013e0aac5. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] Acquiring lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Updating instance_info_cache with network_info: [{"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Releasing lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Instance network_info: |[{"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] Acquired lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Refreshing network info cache for port 15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Start _get_guest_xml network_info=[{"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:49:42 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:49:42 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:49:42 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1833440151',display_name='tempest-VolumesSnapshotTestJSON-instance-1833440151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1833440151',id=28,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodCmdngHU7DW4kSpECxbVLetzQQOVOcPCLA+wI0g7ihA3DpXVEqQQ4dV7tF3s0qxW+yJiy0+io0A2DZyHuKD5C04C9D7VlxkJS/0Hq5LFetVQ3LTi5tSP1hGxBAUj2AQ==',key_name='tempest-keypair-26863168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dc3f94308cd4b99871d9113d6516bfc',ramdisk_id='',reservation_id='r-08m8qcby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-926769811',owner_user_name='tempest-VolumesSnapshotTestJSON-926769811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8c1bccaa174d4da0865d55770703a2',uuid=46065496-7151-4f16-a253-9b62f48ad5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converting VIF {"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=15b2ad33-078c-4923-9d9d-6eb013e0aac5,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b2ad33-07') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'pci_devices' on Instance uuid 46065496-7151-4f16-a253-9b62f48ad5c1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:49:43 user nova-compute[75203]:   <uuid>46065496-7151-4f16-a253-9b62f48ad5c1</uuid>
Nov 28 18:49:43 user nova-compute[75203]:   <name>instance-0000001c</name>
Nov 28 18:49:43 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:49:43 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:49:43 user nova-compute[75203]:   <metadata>
Nov 28 18:49:43 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:49:43 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:49:43 user nova-compute[75203]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1833440151</nova:name>
Nov 28 18:49:43 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:49:42</nova:creationTime>
Nov 28 18:49:43 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:49:43 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:49:43 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:49:43 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:49:43 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:49:43 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:49:43 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:49:43 user nova-compute[75203]:       <nova:owner>
Nov 28 18:49:43 user nova-compute[75203]:         <nova:user uuid="fe8c1bccaa174d4da0865d55770703a2">tempest-VolumesSnapshotTestJSON-926769811-project-member</nova:user>
Nov 28 18:49:43 user nova-compute[75203]:         <nova:project uuid="8dc3f94308cd4b99871d9113d6516bfc">tempest-VolumesSnapshotTestJSON-926769811</nova:project>
Nov 28 18:49:43 user nova-compute[75203]:       </nova:owner>
Nov 28 18:49:43 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:49:43 user nova-compute[75203]:       <nova:ports>
Nov 28 18:49:43 user nova-compute[75203]:         <nova:port uuid="15b2ad33-078c-4923-9d9d-6eb013e0aac5">
Nov 28 18:49:43 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 28 18:49:43 user nova-compute[75203]:         </nova:port>
Nov 28 18:49:43 user nova-compute[75203]:       </nova:ports>
Nov 28 18:49:43 user nova-compute[75203]:     </nova:instance>
Nov 28 18:49:43 user nova-compute[75203]:   </metadata>
Nov 28 18:49:43 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:49:43 user nova-compute[75203]:     <system>
Nov 28 18:49:43 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:49:43 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:49:43 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:49:43 user nova-compute[75203]:       <entry name="serial">46065496-7151-4f16-a253-9b62f48ad5c1</entry>
Nov 28 18:49:43 user nova-compute[75203]:       <entry name="uuid">46065496-7151-4f16-a253-9b62f48ad5c1</entry>
Nov 28 18:49:43 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:49:43 user nova-compute[75203]:     </system>
Nov 28 18:49:43 user nova-compute[75203]:   </sysinfo>
Nov 28 18:49:43 user nova-compute[75203]:   <os>
Nov 28 18:49:43 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:49:43 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:49:43 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:49:43 user nova-compute[75203]:   </os>
Nov 28 18:49:43 user nova-compute[75203]:   <features>
Nov 28 18:49:43 user nova-compute[75203]:     <acpi/>
Nov 28 18:49:43 user nova-compute[75203]:     <apic/>
Nov 28 18:49:43 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:49:43 user nova-compute[75203]:   </features>
Nov 28 18:49:43 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:49:43 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:49:43 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:49:43 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:49:43 user nova-compute[75203]:   </clock>
Nov 28 18:49:43 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:49:43 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:49:43 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:49:43 user nova-compute[75203]:   </cpu>
Nov 28 18:49:43 user nova-compute[75203]:   <devices>
Nov 28 18:49:43 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:49:43 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:49:43 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk"/>
Nov 28 18:49:43 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:49:43 user nova-compute[75203]:     </disk>
Nov 28 18:49:43 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:49:43 user nova-compute[75203]:       <mac address="fa:16:3e:27:b9:f2"/>
Nov 28 18:49:43 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:49:43 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:49:43 user nova-compute[75203]:       <target dev="tap15b2ad33-07"/>
Nov 28 18:49:43 user nova-compute[75203]:     </interface>
Nov 28 18:49:43 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:49:43 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/console.log" append="off"/>
Nov 28 18:49:43 user nova-compute[75203]:     </serial>
Nov 28 18:49:43 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:49:43 user nova-compute[75203]:     <video>
Nov 28 18:49:43 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:49:43 user nova-compute[75203]:     </video>
Nov 28 18:49:43 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:49:43 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:49:43 user nova-compute[75203]:     </rng>
Nov 28 18:49:43 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:49:43 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:49:43 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:49:43 user nova-compute[75203]:     </memballoon>
Nov 28 18:49:43 user nova-compute[75203]:   </devices>
Nov 28 18:49:43 user nova-compute[75203]: </domain>
Nov 28 18:49:43 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1833440151',display_name='tempest-VolumesSnapshotTestJSON-instance-1833440151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1833440151',id=28,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodCmdngHU7DW4kSpECxbVLetzQQOVOcPCLA+wI0g7ihA3DpXVEqQQ4dV7tF3s0qxW+yJiy0+io0A2DZyHuKD5C04C9D7VlxkJS/0Hq5LFetVQ3LTi5tSP1hGxBAUj2AQ==',key_name='tempest-keypair-26863168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dc3f94308cd4b99871d9113d6516bfc',ramdisk_id='',reservation_id='r-08m8qcby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-926769811',owner_user_name='tempest-VolumesSnapshotTestJSON-926769811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:49:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8c1bccaa174d4da0865d55770703a2',uuid=46065496-7151-4f16-a253-9b62f48ad5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converting VIF {"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=15b2ad33-078c-4923-9d9d-6eb013e0aac5,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b2ad33-07') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG os_vif [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=15b2ad33-078c-4923-9d9d-6eb013e0aac5,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b2ad33-07') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f09ca198-b38d-5c3e-bdc0-374c4cd5acd5', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15b2ad33-07, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15b2ad33-07, col_values=(('qos', UUID('df13039b-5ce3-4fb4-ae8b-7e9285173601')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15b2ad33-07, col_values=(('external_ids', {'iface-id': '15b2ad33-078c-4923-9d9d-6eb013e0aac5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:b9:f2', 'vm-uuid': '46065496-7151-4f16-a253-9b62f48ad5c1'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:43 user nova-compute[75203]: INFO os_vif [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=15b2ad33-078c-4923-9d9d-6eb013e0aac5,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b2ad33-07')
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid b61c9405-587d-4b45-9641-7b1e2d73475a {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No VIF found with MAC fa:16:3e:27:b9:f2, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.166s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:43 user nova-compute[75203]: INFO nova.compute.manager [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Attaching volume 4e1bac3f-e5b9-481e-88ff-03c1b2847558 to /dev/vdb
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.network.neutron [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Updated VIF entry in instance network info cache for port 15b2ad33-078c-4923-9d9d-6eb013e0aac5. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.network.neutron [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Updating instance_info_cache with network_info: [{"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6d931f6a-7398-477a-a16f-6b8efb552d94 req-9bf66a76-be78-4ced-9f9b-2dfbb716f4d1 service nova] Releasing lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG os_brick.utils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dcaf1e-97bb-49a4-ad58-22130e8ff9ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c257b29-5ac4-494c-a158-28b5adf76e0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd011894-37b5-4ae4-bf70-8f0adaa91f0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8fb307-5f09-4a46-bc06-f69ecf6d9442]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:49:43 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:49:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a9e115-a1f8-4e4d-892b-7a47c47d7bfa]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG os_brick.utils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:49:43 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Updating existing volume attachment record: d578bf60-946d-4280-8439-f07e8e8803b8 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:49:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:44 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-96ab5387-f6ac-42a4-a2fe-5bbd8c98a8db req-f5c096db-e0a4-4b04-b297-a429113c644c service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-96ab5387-f6ac-42a4-a2fe-5bbd8c98a8db req-f5c096db-e0a4-4b04-b297-a429113c644c service nova] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-96ab5387-f6ac-42a4-a2fe-5bbd8c98a8db req-f5c096db-e0a4-4b04-b297-a429113c644c service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-96ab5387-f6ac-42a4-a2fe-5bbd8c98a8db req-f5c096db-e0a4-4b04-b297-a429113c644c service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:45 user nova-compute[75203]: DEBUG nova.compute.manager [req-96ab5387-f6ac-42a4-a2fe-5bbd8c98a8db req-f5c096db-e0a4-4b04-b297-a429113c644c service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] No waiting events found dispatching network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:49:45 user nova-compute[75203]: WARNING nova.compute.manager [req-96ab5387-f6ac-42a4-a2fe-5bbd8c98a8db req-f5c096db-e0a4-4b04-b297-a429113c644c service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received unexpected event network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 for instance with vm_state building and task_state spawning.
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:49:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Instance spawned successfully.
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:46 user nova-compute[75203]: INFO nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 28 18:49:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:49:46 user nova-compute[75203]: INFO nova.compute.manager [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Took 7.12 seconds to build instance.
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0472ac81-1728-493e-9c9d-b293e816beb3 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.216s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:49:47 user nova-compute[75203]: INFO nova.compute.claims [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Claim successful on node user
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-4126fd85-2875-411d-af21-4c162dc34396 req-705a36d3-e826-4e04-af5c-b22c46f6f837 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4126fd85-2875-411d-af21-4c162dc34396 req-705a36d3-e826-4e04-af5c-b22c46f6f837 service nova] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4126fd85-2875-411d-af21-4c162dc34396 req-705a36d3-e826-4e04-af5c-b22c46f6f837 service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4126fd85-2875-411d-af21-4c162dc34396 req-705a36d3-e826-4e04-af5c-b22c46f6f837 service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-4126fd85-2875-411d-af21-4c162dc34396 req-705a36d3-e826-4e04-af5c-b22c46f6f837 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] No waiting events found dispatching network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:49:47 user nova-compute[75203]: WARNING nova.compute.manager [req-4126fd85-2875-411d-af21-4c162dc34396 req-705a36d3-e826-4e04-af5c-b22c46f6f837 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received unexpected event network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 for instance with vm_state active and task_state None.
Nov 28 18:49:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.480s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:49:48 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.policy [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'caa3702219cd4ca48fd9754cf1037f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9091039cac4e20b440f4852ad7f293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:49:48 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Creating image(s)
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk 1073741824" returned: 0 in 0.055s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG nova.network.neutron [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Successfully created port: b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.234s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Cannot resize image /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Ensure instance console log exists: /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Successfully updated port: b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing instance network info cache due to event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG nova.network.neutron [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:49:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance network_info: |[{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Start _get_guest_xml network_info=[{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:49:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:49:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-216485763',display_name='tempest-ServerStableDeviceRescueTest-server-216485763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-216485763',id=29,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjBUTde2IUZlcPjPkqpXPTcC7hMwTKmf94yvJIrIK8uKKAS2lss5668VzKj/wB72dIaaLGe8rlmmbo8x90E2y6UipdIw8Ly7yjNOtIju+jcy0xA9ygkZvM3Y+jWjHIidQ==',key_name='tempest-keypair-696441057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e9091039cac4e20b440f4852ad7f293',ramdisk_id='',reservation_id='r-oojliyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1663211552',owner_user_name='tempest-ServerStableDeviceRescueTest-1663211552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='caa3702219cd4ca48fd9754cf1037f24',uuid=2dcad16f-a0dd-4d8d-829e-16e9e6093cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converting VIF {"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:49:51 user nova-compute[75203]:   <uuid>2dcad16f-a0dd-4d8d-829e-16e9e6093cf4</uuid>
Nov 28 18:49:51 user nova-compute[75203]:   <name>instance-0000001d</name>
Nov 28 18:49:51 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:49:51 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:49:51 user nova-compute[75203]:   <metadata>
Nov 28 18:49:51 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:49:51 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:49:51 user nova-compute[75203]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-216485763</nova:name>
Nov 28 18:49:51 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:49:51</nova:creationTime>
Nov 28 18:49:51 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:49:51 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:49:51 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:49:51 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:49:51 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:49:51 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:49:51 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:49:51 user nova-compute[75203]:       <nova:owner>
Nov 28 18:49:51 user nova-compute[75203]:         <nova:user uuid="caa3702219cd4ca48fd9754cf1037f24">tempest-ServerStableDeviceRescueTest-1663211552-project-member</nova:user>
Nov 28 18:49:51 user nova-compute[75203]:         <nova:project uuid="0e9091039cac4e20b440f4852ad7f293">tempest-ServerStableDeviceRescueTest-1663211552</nova:project>
Nov 28 18:49:51 user nova-compute[75203]:       </nova:owner>
Nov 28 18:49:51 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:49:51 user nova-compute[75203]:       <nova:ports>
Nov 28 18:49:51 user nova-compute[75203]:         <nova:port uuid="b48b28f4-803d-4ec6-9acd-53b1f4c11568">
Nov 28 18:49:51 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 18:49:51 user nova-compute[75203]:         </nova:port>
Nov 28 18:49:51 user nova-compute[75203]:       </nova:ports>
Nov 28 18:49:51 user nova-compute[75203]:     </nova:instance>
Nov 28 18:49:51 user nova-compute[75203]:   </metadata>
Nov 28 18:49:51 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:49:51 user nova-compute[75203]:     <system>
Nov 28 18:49:51 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:49:51 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:49:51 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:49:51 user nova-compute[75203]:       <entry name="serial">2dcad16f-a0dd-4d8d-829e-16e9e6093cf4</entry>
Nov 28 18:49:51 user nova-compute[75203]:       <entry name="uuid">2dcad16f-a0dd-4d8d-829e-16e9e6093cf4</entry>
Nov 28 18:49:51 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:49:51 user nova-compute[75203]:     </system>
Nov 28 18:49:51 user nova-compute[75203]:   </sysinfo>
Nov 28 18:49:51 user nova-compute[75203]:   <os>
Nov 28 18:49:51 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:49:51 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:49:51 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:49:51 user nova-compute[75203]:   </os>
Nov 28 18:49:51 user nova-compute[75203]:   <features>
Nov 28 18:49:51 user nova-compute[75203]:     <acpi/>
Nov 28 18:49:51 user nova-compute[75203]:     <apic/>
Nov 28 18:49:51 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:49:51 user nova-compute[75203]:   </features>
Nov 28 18:49:51 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:49:51 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:49:51 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:49:51 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:49:51 user nova-compute[75203]:   </clock>
Nov 28 18:49:51 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:49:51 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:49:51 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:49:51 user nova-compute[75203]:   </cpu>
Nov 28 18:49:51 user nova-compute[75203]:   <devices>
Nov 28 18:49:51 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:49:51 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:49:51 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk"/>
Nov 28 18:49:51 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:49:51 user nova-compute[75203]:     </disk>
Nov 28 18:49:51 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:49:51 user nova-compute[75203]:       <mac address="fa:16:3e:af:ed:f9"/>
Nov 28 18:49:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:49:51 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:49:51 user nova-compute[75203]:       <target dev="tapb48b28f4-80"/>
Nov 28 18:49:51 user nova-compute[75203]:     </interface>
Nov 28 18:49:51 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:49:51 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/console.log" append="off"/>
Nov 28 18:49:51 user nova-compute[75203]:     </serial>
Nov 28 18:49:51 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:49:51 user nova-compute[75203]:     <video>
Nov 28 18:49:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:49:51 user nova-compute[75203]:     </video>
Nov 28 18:49:51 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:49:51 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:49:51 user nova-compute[75203]:     </rng>
Nov 28 18:49:51 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:49:51 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:49:51 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:49:51 user nova-compute[75203]:     </memballoon>
Nov 28 18:49:51 user nova-compute[75203]:   </devices>
Nov 28 18:49:51 user nova-compute[75203]: </domain>
Nov 28 18:49:51 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-216485763',display_name='tempest-ServerStableDeviceRescueTest-server-216485763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-216485763',id=29,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjBUTde2IUZlcPjPkqpXPTcC7hMwTKmf94yvJIrIK8uKKAS2lss5668VzKj/wB72dIaaLGe8rlmmbo8x90E2y6UipdIw8Ly7yjNOtIju+jcy0xA9ygkZvM3Y+jWjHIidQ==',key_name='tempest-keypair-696441057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e9091039cac4e20b440f4852ad7f293',ramdisk_id='',reservation_id='r-oojliyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1663211552',owner_user_name='tempest-ServerStableDeviceRescueTest-1663211552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='caa3702219cd4ca48fd9754cf1037f24',uuid=2dcad16f-a0dd-4d8d-829e-16e9e6093cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converting VIF {"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG os_vif [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84cf1254-0faf-57a9-ae0a-85942f39c9ff', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb48b28f4-80, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb48b28f4-80, col_values=(('qos', UUID('dff6d6dc-5cd6-4dd3-9b6a-55f8a8f0c8f4')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb48b28f4-80, col_values=(('external_ids', {'iface-id': 'b48b28f4-803d-4ec6-9acd-53b1f4c11568', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:ed:f9', 'vm-uuid': '2dcad16f-a0dd-4d8d-829e-16e9e6093cf4'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:51 user nova-compute[75203]: INFO os_vif [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80')
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No VIF found with MAC fa:16:3e:af:ed:f9, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updated VIF entry in instance network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6387e488-b4a7-4f16-9734-39252d4a8e3c req-4a0445fc-a63d-4654-8233-a07eb07b63f7 service nova] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:49:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-029b6356-eb3c-4117-bc38-b4392114dcb4 req-d773f837-a6c7-42e5-b426-064456c238c9 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-029b6356-eb3c-4117-bc38-b4392114dcb4 req-d773f837-a6c7-42e5-b426-064456c238c9 service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-029b6356-eb3c-4117-bc38-b4392114dcb4 req-d773f837-a6c7-42e5-b426-064456c238c9 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-029b6356-eb3c-4117-bc38-b4392114dcb4 req-d773f837-a6c7-42e5-b426-064456c238c9 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-029b6356-eb3c-4117-bc38-b4392114dcb4 req-d773f837-a6c7-42e5-b426-064456c238c9 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:49:55 user nova-compute[75203]: WARNING nova.compute.manager [req-029b6356-eb3c-4117-bc38-b4392114dcb4 req-d773f837-a6c7-42e5-b426-064456c238c9 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state building and task_state spawning.
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-1a1fa65a-6c50-48c7-a82f-574769ea9a35 req-fda09367-598c-47aa-9e87-f6ce580abc29 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1a1fa65a-6c50-48c7-a82f-574769ea9a35 req-fda09367-598c-47aa-9e87-f6ce580abc29 service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1a1fa65a-6c50-48c7-a82f-574769ea9a35 req-fda09367-598c-47aa-9e87-f6ce580abc29 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1a1fa65a-6c50-48c7-a82f-574769ea9a35 req-fda09367-598c-47aa-9e87-f6ce580abc29 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-1a1fa65a-6c50-48c7-a82f-574769ea9a35 req-fda09367-598c-47aa-9e87-f6ce580abc29 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:49:55 user nova-compute[75203]: WARNING nova.compute.manager [req-1a1fa65a-6c50-48c7-a82f-574769ea9a35 req-fda09367-598c-47aa-9e87-f6ce580abc29 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state building and task_state spawning.
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpArJZFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:49:55 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:49:55 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:49:55 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:49:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7999MB free_disk=25.034141540527344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance spawned successfully.
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c6e94-8383-477d-9162-092a8d00b61c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:49:55 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: INFO nova.compute.manager [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Terminating instance
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[859b3def-0f58-4ab8-899a-8b93e48b87f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558] added
Nov 28 18:49:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa3c69-e109-4ae5-a502-28a9188483c2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d767812e-a953-48ae-a92e-088e18affdd3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:55 user nova-compute[75203]: INFO nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpArJZFc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Applying migration context for instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 as it has an incoming, in-progress migration 793e550e-426f-4963-aee1-4d856435d83b. Migration status is finished {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 28 18:49:55 user nova-compute[75203]: INFO nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating resource usage from migration 793e550e-426f-4963-aee1-4d856435d83b
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpArJZFc" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3440acb-d61c-4e08-85ca-40f241467340]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpArJZFc'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 13524911-1006-4646-9c67-def22fb36ac4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b61c9405-587d-4b45-9641-7b1e2d73475a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Migration 793e550e-426f-4963-aee1-4d856435d83b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 46065496-7151-4f16-a253-9b62f48ad5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.151s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85d45d1-4d9a-4ec4-ab9b-d7315a1da889]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: INFO nova.compute.manager [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Took 8.18 seconds to build instance.
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca3cba3-aac4-4e9c-b4d8-1f10b157a7b1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:49:55 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:49:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:49:55 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:49:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e60b42fb-fcef-46df-aaa6-3bf763f87d50 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.278s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1244167-878d-4ce9-8c20-e3f36df14b77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260]
Nov 28 18:49:56 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260] successful.
Nov 28 18:49:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fc323e-93b9-4cb3-a2bf-7d463888fe9b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-038b19bd-201c-48d5-b3a7-d50e4f5021b6 req-7920660f-1087-4f62-946b-8e2f6a3aab55 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-038b19bd-201c-48d5-b3a7-d50e4f5021b6 req-7920660f-1087-4f62-946b-8e2f6a3aab55 service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-038b19bd-201c-48d5-b3a7-d50e4f5021b6 req-7920660f-1087-4f62-946b-8e2f6a3aab55 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-038b19bd-201c-48d5-b3a7-d50e4f5021b6 req-7920660f-1087-4f62-946b-8e2f6a3aab55 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-038b19bd-201c-48d5-b3a7-d50e4f5021b6 req-7920660f-1087-4f62-946b-8e2f6a3aab55 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-038b19bd-201c-48d5-b3a7-d50e4f5021b6 req-7920660f-1087-4f62-946b-8e2f6a3aab55 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-unplugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[921eac70-48cc-4cca-a446-c214fb1f8eac]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:49:56 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:49:56 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:49:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:49:56 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:49:56 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:49:56 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.513s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6d949-fdbf-4b2f-b692-d9638de84242]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpArJZFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.783s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Instance destroyed successfully.
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.objects.instance [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'resources' on Instance uuid 13524911-1006-4646-9c67-def22fb36ac4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1420770283',display_name='tempest-ServerRescueNegativeTestJSON-server-1420770283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1420770283',id=22,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYqxDm1iqu7KJ8Zdx8M2rPxexXzFXDX5EicJ2fN3cU5P6guw7wY8B61FlpPlU88Nr0OX0nonX4l48XyofV5e3ZkWSmjfyEbPd5+NmuWaMN89mpHnmgjwUH5ahQB+tqjLA==',key_name='tempest-keypair-1064251055',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:45:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-7onh3nn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=13524911-1006-4646-9c67-def22fb36ac4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "address": "fa:16:3e:4b:cc:1a", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93f2167d-e2", "ovs_interfaceid": "93f2167d-e2f4-49cc-9a16-f423db7c60a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG os_vif [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93f2167d-e2, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e2fc3cb-9442-4089-bc5f-8f36f9c7225a) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:56 user nova-compute[75203]: INFO os_vif [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cc:1a,bridge_name='br-int',has_traffic_filtering=True,id=93f2167d-e2f4-49cc-9a16-f423db7c60a9,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93f2167d-e2')
Nov 28 18:49:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Deleting instance files /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4_del
Nov 28 18:49:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Deletion of /opt/stack/data/nova/instances/13524911-1006-4646-9c67-def22fb36ac4_del complete
Nov 28 18:49:56 user nova-compute[75203]: INFO nova.compute.manager [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 28 18:49:56 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:49:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.550s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== connect_volume: return (1552ms) {'type': 'block', 'scsi_wwn': '23932366333363261', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932366333363261', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.objects.instance [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid b61c9405-587d-4b45-9641-7b1e2d73475a {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:49:57 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:49:57 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:49:57 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:49:57 user nova-compute[75203]:   <serial>4e1bac3f-e5b9-481e-88ff-03c1b2847558</serial>
Nov 28 18:49:57 user nova-compute[75203]: </disk>
Nov 28 18:49:57 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Skipping network cache update for instance because it is being deleted. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No VIF found with MAC fa:16:3e:d9:08:3a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-56c9f69a-6e5a-4d0d-aaf4-5f41acb8a037 req-e6c197c5-9362-465d-836c-84bf0747b166 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-deleted-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:57 user nova-compute[75203]: INFO nova.compute.manager [req-56c9f69a-6e5a-4d0d-aaf4-5f41acb8a037 req-e6c197c5-9362-465d-836c-84bf0747b166 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Neutron deleted interface 93f2167d-e2f4-49cc-9a16-f423db7c60a9; detaching it from the instance and deleting it from the info cache
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.network.neutron [req-56c9f69a-6e5a-4d0d-aaf4-5f41acb8a037 req-e6c197c5-9362-465d-836c-84bf0747b166 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:57 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Took 1.01 seconds to deallocate network for instance.
Nov 28 18:49:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-56c9f69a-6e5a-4d0d-aaf4-5f41acb8a037 req-e6c197c5-9362-465d-836c-84bf0747b166 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Detach interface failed, port_id=93f2167d-e2f4-49cc-9a16-f423db7c60a9, reason: Instance 13524911-1006-4646-9c67-def22fb36ac4 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-da72d21f-8619-422d-952d-ed7633e4497b tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.256s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [{"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-fafd72ff-f097-4605-b7d5-c4d68ca082dc" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-171f7d5b-1fae-4d3d-887d-9ed3e598c322 req-b610f3bf-c995-4751-b77a-a91fac05b264 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-171f7d5b-1fae-4d3d-887d-9ed3e598c322 req-b610f3bf-c995-4751-b77a-a91fac05b264 service nova] Acquiring lock "13524911-1006-4646-9c67-def22fb36ac4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-171f7d5b-1fae-4d3d-887d-9ed3e598c322 req-b610f3bf-c995-4751-b77a-a91fac05b264 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-171f7d5b-1fae-4d3d-887d-9ed3e598c322 req-b610f3bf-c995-4751-b77a-a91fac05b264 service nova] Lock "13524911-1006-4646-9c67-def22fb36ac4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-171f7d5b-1fae-4d3d-887d-9ed3e598c322 req-b610f3bf-c995-4751-b77a-a91fac05b264 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] No waiting events found dispatching network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:49:58 user nova-compute[75203]: WARNING nova.compute.manager [req-171f7d5b-1fae-4d3d-887d-9ed3e598c322 req-b610f3bf-c995-4751-b77a-a91fac05b264 service nova] [instance: 13524911-1006-4646-9c67-def22fb36ac4] Received unexpected event network-vif-plugged-93f2167d-e2f4-49cc-9a16-f423db7c60a9 for instance with vm_state deleted and task_state None.
Nov 28 18:49:58 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:58 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Deleted allocations for instance 13524911-1006-4646-9c67-def22fb36ac4
Nov 28 18:49:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-96cf98c4-1e1a-4aaf-96ac-134918ea44a5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "13524911-1006-4646-9c67-def22fb36ac4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.893s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:49:59 user nova-compute[75203]: INFO nova.compute.claims [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Claim successful on node user
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.network.neutron [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:49:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:49:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Creating image(s)
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "/opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "/opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:49:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG nova.policy [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33f323fd910b4786931b7eb264db9da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0360ef8662aa453197be485b3c4a1c33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.224s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk 1073741824" returned: 0 in 0.068s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Cannot resize image /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Ensure instance console log exists: /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Successfully created port: 476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Successfully updated port: 476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "refresh_cache-b3650574-c55d-4b95-8dbf-7e884acbfccf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquired lock "refresh_cache-b3650574-c55d-4b95-8dbf-7e884acbfccf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received event network-changed-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Refreshing instance network info cache due to event network-changed-476f9a19-4f47-426f-8653-1d74368f6c73. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] Acquiring lock "refresh_cache-b3650574-c55d-4b95-8dbf-7e884acbfccf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:50:01 user nova-compute[75203]: INFO nova.compute.claims [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Claim successful on node user
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Updating instance_info_cache with network_info: [{"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Releasing lock "refresh_cache-b3650574-c55d-4b95-8dbf-7e884acbfccf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Instance network_info: |[{"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] Acquired lock "refresh_cache-b3650574-c55d-4b95-8dbf-7e884acbfccf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Refreshing network info cache for port 476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Start _get_guest_xml network_info=[{"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:50:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-568471815',display_name='tempest-VolumesNegativeTest-instance-568471815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-568471815',id=30,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0360ef8662aa453197be485b3c4a1c33',ramdisk_id='',reservation_id='r-xwe3k3aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1649454180',owner_user_name='tempest-VolumesNegativeTest-1649454180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:50:00Z,user_data=None,user_id='33f323fd910b4786931b7eb264db9da2',uuid=b3650574-c55d-4b95-8dbf-7e884acbfccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Converting VIF {"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:7d:81,bridge_name='br-int',has_traffic_filtering=True,id=476f9a19-4f47-426f-8653-1d74368f6c73,network=Network(02c47140-88dd-480c-95af-54e10276b8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap476f9a19-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.objects.instance [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lazy-loading 'pci_devices' on Instance uuid b3650574-c55d-4b95-8dbf-7e884acbfccf {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:50:02 user nova-compute[75203]:   <uuid>b3650574-c55d-4b95-8dbf-7e884acbfccf</uuid>
Nov 28 18:50:02 user nova-compute[75203]:   <name>instance-0000001e</name>
Nov 28 18:50:02 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:50:02 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:50:02 user nova-compute[75203]:   <metadata>
Nov 28 18:50:02 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:50:02 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:50:02 user nova-compute[75203]:       <nova:name>tempest-VolumesNegativeTest-instance-568471815</nova:name>
Nov 28 18:50:02 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:50:02</nova:creationTime>
Nov 28 18:50:02 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:50:02 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:50:02 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:50:02 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:50:02 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:50:02 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:50:02 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:50:02 user nova-compute[75203]:       <nova:owner>
Nov 28 18:50:02 user nova-compute[75203]:         <nova:user uuid="33f323fd910b4786931b7eb264db9da2">tempest-VolumesNegativeTest-1649454180-project-member</nova:user>
Nov 28 18:50:02 user nova-compute[75203]:         <nova:project uuid="0360ef8662aa453197be485b3c4a1c33">tempest-VolumesNegativeTest-1649454180</nova:project>
Nov 28 18:50:02 user nova-compute[75203]:       </nova:owner>
Nov 28 18:50:02 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:50:02 user nova-compute[75203]:       <nova:ports>
Nov 28 18:50:02 user nova-compute[75203]:         <nova:port uuid="476f9a19-4f47-426f-8653-1d74368f6c73">
Nov 28 18:50:02 user nova-compute[75203]:           <nova:ip type="fixed" address="192.168.233.32" ipVersion="4"/>
Nov 28 18:50:02 user nova-compute[75203]:         </nova:port>
Nov 28 18:50:02 user nova-compute[75203]:       </nova:ports>
Nov 28 18:50:02 user nova-compute[75203]:     </nova:instance>
Nov 28 18:50:02 user nova-compute[75203]:   </metadata>
Nov 28 18:50:02 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:50:02 user nova-compute[75203]:     <system>
Nov 28 18:50:02 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:50:02 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:50:02 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:50:02 user nova-compute[75203]:       <entry name="serial">b3650574-c55d-4b95-8dbf-7e884acbfccf</entry>
Nov 28 18:50:02 user nova-compute[75203]:       <entry name="uuid">b3650574-c55d-4b95-8dbf-7e884acbfccf</entry>
Nov 28 18:50:02 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:50:02 user nova-compute[75203]:     </system>
Nov 28 18:50:02 user nova-compute[75203]:   </sysinfo>
Nov 28 18:50:02 user nova-compute[75203]:   <os>
Nov 28 18:50:02 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:50:02 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:50:02 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:50:02 user nova-compute[75203]:   </os>
Nov 28 18:50:02 user nova-compute[75203]:   <features>
Nov 28 18:50:02 user nova-compute[75203]:     <acpi/>
Nov 28 18:50:02 user nova-compute[75203]:     <apic/>
Nov 28 18:50:02 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:50:02 user nova-compute[75203]:   </features>
Nov 28 18:50:02 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:50:02 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:50:02 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:50:02 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:50:02 user nova-compute[75203]:   </clock>
Nov 28 18:50:02 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:50:02 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:50:02 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:50:02 user nova-compute[75203]:   </cpu>
Nov 28 18:50:02 user nova-compute[75203]:   <devices>
Nov 28 18:50:02 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:50:02 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:50:02 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk"/>
Nov 28 18:50:02 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:50:02 user nova-compute[75203]:     </disk>
Nov 28 18:50:02 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:50:02 user nova-compute[75203]:       <mac address="fa:16:3e:be:7d:81"/>
Nov 28 18:50:02 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:50:02 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:50:02 user nova-compute[75203]:       <target dev="tap476f9a19-4f"/>
Nov 28 18:50:02 user nova-compute[75203]:     </interface>
Nov 28 18:50:02 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:50:02 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/console.log" append="off"/>
Nov 28 18:50:02 user nova-compute[75203]:     </serial>
Nov 28 18:50:02 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:50:02 user nova-compute[75203]:     <video>
Nov 28 18:50:02 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:50:02 user nova-compute[75203]:     </video>
Nov 28 18:50:02 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:50:02 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:50:02 user nova-compute[75203]:     </rng>
Nov 28 18:50:02 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:50:02 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:50:02 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:50:02 user nova-compute[75203]:     </memballoon>
Nov 28 18:50:02 user nova-compute[75203]:   </devices>
Nov 28 18:50:02 user nova-compute[75203]: </domain>
Nov 28 18:50:02 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-568471815',display_name='tempest-VolumesNegativeTest-instance-568471815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-568471815',id=30,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0360ef8662aa453197be485b3c4a1c33',ramdisk_id='',reservation_id='r-xwe3k3aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1649454180',owner_user_name='tempest-VolumesNegativeTest-1649454180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:50:00Z,user_data=None,user_id='33f323fd910b4786931b7eb264db9da2',uuid=b3650574-c55d-4b95-8dbf-7e884acbfccf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Converting VIF {"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:7d:81,bridge_name='br-int',has_traffic_filtering=True,id=476f9a19-4f47-426f-8653-1d74368f6c73,network=Network(02c47140-88dd-480c-95af-54e10276b8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap476f9a19-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG os_vif [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:7d:81,bridge_name='br-int',has_traffic_filtering=True,id=476f9a19-4f47-426f-8653-1d74368f6c73,network=Network(02c47140-88dd-480c-95af-54e10276b8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap476f9a19-4f') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ecd7290-b198-5354-94f9-f5a282a6c0a9', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Going to confirm migration 2 {{(pid=75203) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap476f9a19-4f, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap476f9a19-4f, col_values=(('qos', UUID('5a4dd303-2463-4a44-8652-4151f612acd6')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap476f9a19-4f, col_values=(('external_ids', {'iface-id': '476f9a19-4f47-426f-8653-1d74368f6c73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:7d:81', 'vm-uuid': 'b3650574-c55d-4b95-8dbf-7e884acbfccf'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:02 user nova-compute[75203]: INFO os_vif [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:7d:81,bridge_name='br-int',has_traffic_filtering=True,id=476f9a19-4f47-426f-8653-1d74368f6c73,network=Network(02c47140-88dd-480c-95af-54e10276b8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap476f9a19-4f')
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] No VIF found with MAC fa:16:3e:be:7d:81, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquired lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.objects.instance [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'info_cache' on Instance uuid cf87ffa2-f1e7-49c1-8b09-51a5d080b652 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:50:02 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.policy [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e0355eaade04b2b9d377a6b2c78585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e597eb0284510980106d2de8c235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Updated VIF entry in instance network info cache for port 476f9a19-4f47-426f-8653-1d74368f6c73. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.network.neutron [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Updating instance_info_cache with network_info: [{"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:50:02 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Creating image(s)
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "/opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0c32d6cd-3c67-4e9f-939c-f8ce5aba12a8 req-3f0d174d-b511-4492-bdeb-437b8860c2d9 service nova] Releasing lock "refresh_cache-b3650574-c55d-4b95-8dbf-7e884acbfccf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating instance_info_cache with network_info: [{"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk 1073741824" returned: 0 in 0.052s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Releasing lock "refresh_cache-cf87ffa2-f1e7-49c1-8b09-51a5d080b652" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.objects.instance [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'migration_context' on Instance uuid cf87ffa2-f1e7-49c1-8b09-51a5d080b652 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.objects.base [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Object Instance<cf87ffa2-f1e7-49c1-8b09-51a5d080b652> lazy-loaded attributes: info_cache,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.225s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Cannot resize image /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Ensure instance console log exists: /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Successfully created port: 66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:50:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.717s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-2ce783c5-82dd-45ae-ab1a-6e538504b21a req-9a1f4ea7-536c-40aa-bbe9-87dc045d3126 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received event network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2ce783c5-82dd-45ae-ab1a-6e538504b21a req-9a1f4ea7-536c-40aa-bbe9-87dc045d3126 service nova] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2ce783c5-82dd-45ae-ab1a-6e538504b21a req-9a1f4ea7-536c-40aa-bbe9-87dc045d3126 service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2ce783c5-82dd-45ae-ab1a-6e538504b21a req-9a1f4ea7-536c-40aa-bbe9-87dc045d3126 service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-2ce783c5-82dd-45ae-ab1a-6e538504b21a req-9a1f4ea7-536c-40aa-bbe9-87dc045d3126 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] No waiting events found dispatching network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:04 user nova-compute[75203]: WARNING nova.compute.manager [req-2ce783c5-82dd-45ae-ab1a-6e538504b21a req-9a1f4ea7-536c-40aa-bbe9-87dc045d3126 service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received unexpected event network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 for instance with vm_state building and task_state spawning.
Nov 28 18:50:04 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Deleted allocation for migration 793e550e-426f-4963-aee1-4d856435d83b
Nov 28 18:50:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-66d356e0-8c91-4df8-b589-a90034a348da tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.064s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG nova.network.neutron [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Successfully updated port: 66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquired lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG nova.network.neutron [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:50:04 user nova-compute[75203]: DEBUG nova.network.neutron [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.network.neutron [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Updating instance_info_cache with network_info: [{"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Releasing lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Instance network_info: |[{"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Start _get_guest_xml network_info=[{"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:50:05 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:05 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-167849791',display_name='tempest-AttachVolumeNegativeTest-server-167849791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-167849791',id=31,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVtUHUN0MR2UCGB2gqLrPFzQIRVgl4rmMRnuo6pYChJFmfGIyoILvMX0y+m34YoVP4k1EW9WFQPB/lhvU+vfyvusguKRcvRbHKW1FjDu0iAPLnIJevE8zD6p/szCmV2Sg==',key_name='tempest-keypair-1556149755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-988631he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=687fe1ad-9990-4c9c-8c77-f2210c780df8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:51,bridge_name='br-int',has_traffic_filtering=True,id=66a2b0a4-209a-4675-a026-24da8e88ed3f,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2b0a4-20') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.objects.instance [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'pci_devices' on Instance uuid 687fe1ad-9990-4c9c-8c77-f2210c780df8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:50:05 user nova-compute[75203]:   <uuid>687fe1ad-9990-4c9c-8c77-f2210c780df8</uuid>
Nov 28 18:50:05 user nova-compute[75203]:   <name>instance-0000001f</name>
Nov 28 18:50:05 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:50:05 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:50:05 user nova-compute[75203]:   <metadata>
Nov 28 18:50:05 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:50:05 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:50:05 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeNegativeTest-server-167849791</nova:name>
Nov 28 18:50:05 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:50:05</nova:creationTime>
Nov 28 18:50:05 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:50:05 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:50:05 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:50:05 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:50:05 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:50:05 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:50:05 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:50:05 user nova-compute[75203]:       <nova:owner>
Nov 28 18:50:05 user nova-compute[75203]:         <nova:user uuid="7e0355eaade04b2b9d377a6b2c78585e">tempest-AttachVolumeNegativeTest-977864769-project-member</nova:user>
Nov 28 18:50:05 user nova-compute[75203]:         <nova:project uuid="d40e597eb0284510980106d2de8c235b">tempest-AttachVolumeNegativeTest-977864769</nova:project>
Nov 28 18:50:05 user nova-compute[75203]:       </nova:owner>
Nov 28 18:50:05 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:50:05 user nova-compute[75203]:       <nova:ports>
Nov 28 18:50:05 user nova-compute[75203]:         <nova:port uuid="66a2b0a4-209a-4675-a026-24da8e88ed3f">
Nov 28 18:50:05 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 18:50:05 user nova-compute[75203]:         </nova:port>
Nov 28 18:50:05 user nova-compute[75203]:       </nova:ports>
Nov 28 18:50:05 user nova-compute[75203]:     </nova:instance>
Nov 28 18:50:05 user nova-compute[75203]:   </metadata>
Nov 28 18:50:05 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:50:05 user nova-compute[75203]:     <system>
Nov 28 18:50:05 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:50:05 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:50:05 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:50:05 user nova-compute[75203]:       <entry name="serial">687fe1ad-9990-4c9c-8c77-f2210c780df8</entry>
Nov 28 18:50:05 user nova-compute[75203]:       <entry name="uuid">687fe1ad-9990-4c9c-8c77-f2210c780df8</entry>
Nov 28 18:50:05 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:50:05 user nova-compute[75203]:     </system>
Nov 28 18:50:05 user nova-compute[75203]:   </sysinfo>
Nov 28 18:50:05 user nova-compute[75203]:   <os>
Nov 28 18:50:05 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:50:05 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:50:05 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:50:05 user nova-compute[75203]:   </os>
Nov 28 18:50:05 user nova-compute[75203]:   <features>
Nov 28 18:50:05 user nova-compute[75203]:     <acpi/>
Nov 28 18:50:05 user nova-compute[75203]:     <apic/>
Nov 28 18:50:05 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:50:05 user nova-compute[75203]:   </features>
Nov 28 18:50:05 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:50:05 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:50:05 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:50:05 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:50:05 user nova-compute[75203]:   </clock>
Nov 28 18:50:05 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:50:05 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:50:05 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:50:05 user nova-compute[75203]:   </cpu>
Nov 28 18:50:05 user nova-compute[75203]:   <devices>
Nov 28 18:50:05 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:50:05 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:50:05 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk"/>
Nov 28 18:50:05 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:50:05 user nova-compute[75203]:     </disk>
Nov 28 18:50:05 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:50:05 user nova-compute[75203]:       <mac address="fa:16:3e:5a:cd:51"/>
Nov 28 18:50:05 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:50:05 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:50:05 user nova-compute[75203]:       <target dev="tap66a2b0a4-20"/>
Nov 28 18:50:05 user nova-compute[75203]:     </interface>
Nov 28 18:50:05 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:50:05 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/console.log" append="off"/>
Nov 28 18:50:05 user nova-compute[75203]:     </serial>
Nov 28 18:50:05 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:50:05 user nova-compute[75203]:     <video>
Nov 28 18:50:05 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:50:05 user nova-compute[75203]:     </video>
Nov 28 18:50:05 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:50:05 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:50:05 user nova-compute[75203]:     </rng>
Nov 28 18:50:05 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:50:05 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:50:05 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:50:05 user nova-compute[75203]:     </memballoon>
Nov 28 18:50:05 user nova-compute[75203]:   </devices>
Nov 28 18:50:05 user nova-compute[75203]: </domain>
Nov 28 18:50:05 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-167849791',display_name='tempest-AttachVolumeNegativeTest-server-167849791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-167849791',id=31,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVtUHUN0MR2UCGB2gqLrPFzQIRVgl4rmMRnuo6pYChJFmfGIyoILvMX0y+m34YoVP4k1EW9WFQPB/lhvU+vfyvusguKRcvRbHKW1FjDu0iAPLnIJevE8zD6p/szCmV2Sg==',key_name='tempest-keypair-1556149755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-988631he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=687fe1ad-9990-4c9c-8c77-f2210c780df8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:51,bridge_name='br-int',has_traffic_filtering=True,id=66a2b0a4-209a-4675-a026-24da8e88ed3f,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2b0a4-20') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG os_vif [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:51,bridge_name='br-int',has_traffic_filtering=True,id=66a2b0a4-209a-4675-a026-24da8e88ed3f,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2b0a4-20') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c161a66-ec51-54cf-b0e0-a6395ce30123', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66a2b0a4-20, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66a2b0a4-20, col_values=(('qos', UUID('95041a97-9602-4838-8e4e-fbfdfcaab188')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66a2b0a4-20, col_values=(('external_ids', {'iface-id': '66a2b0a4-209a-4675-a026-24da8e88ed3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:cd:51', 'vm-uuid': '687fe1ad-9990-4c9c-8c77-f2210c780df8'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:05 user nova-compute[75203]: INFO os_vif [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:51,bridge_name='br-int',has_traffic_filtering=True,id=66a2b0a4-209a-4675-a026-24da8e88ed3f,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2b0a4-20')
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No VIF found with MAC fa:16:3e:5a:cd:51, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:50:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Instance spawned successfully.
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:05 user nova-compute[75203]: INFO nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 28 18:50:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:50:05 user nova-compute[75203]: INFO nova.compute.manager [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Took 6.83 seconds to build instance.
Nov 28 18:50:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-107e5dff-f7d5-4f2e-af22-e186e0ed836e tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.928s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received event network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] No waiting events found dispatching network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:06 user nova-compute[75203]: WARNING nova.compute.manager [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received unexpected event network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 for instance with vm_state active and task_state None.
Nov 28 18:50:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-changed-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Refreshing instance network info cache due to event network-changed-66a2b0a4-209a-4675-a026-24da8e88ed3f. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] Acquiring lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] Acquired lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Refreshing network info cache for port 66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Updated VIF entry in instance network info cache for port 66a2b0a4-209a-4675-a026-24da8e88ed3f. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Updating instance_info_cache with network_info: [{"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e7da6f50-7f92-45c5-bb5e-d661a02dcd07 req-f40ea977-6736-42bb-b35c-1a9c2645d1dd service nova] Releasing lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] No waiting events found dispatching network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:08 user nova-compute[75203]: WARNING nova.compute.manager [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received unexpected event network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f for instance with vm_state building and task_state spawning.
Nov 28 18:50:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] No waiting events found dispatching network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:08 user nova-compute[75203]: WARNING nova.compute.manager [req-c905f894-49ad-4778-acb0-6bbaf14dc693 req-3b973c6d-bb18-4702-afcd-2c223d690341 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received unexpected event network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f for instance with vm_state building and task_state spawning.
Nov 28 18:50:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:50:09 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Instance spawned successfully.
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:09 user nova-compute[75203]: INFO nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 28 18:50:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:50:09 user nova-compute[75203]: INFO nova.compute.manager [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Took 7.49 seconds to build instance.
Nov 28 18:50:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-04a2fa40-6985-4be0-9a8c-b97f0500da29 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.589s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:50:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:32 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:50:32 user nova-compute[75203]: INFO nova.compute.claims [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Claim successful on node user
Nov 28 18:50:32 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:50:33 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.policy [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad9a9772df954da0b42b5b102440c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1aaec341d441fb4da4fc53a985617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:50:33 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Creating image(s)
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk 1073741824" returned: 0 in 0.060s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:33 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Successfully created port: 2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.242s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Cannot resize image /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Ensure instance console log exists: /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Successfully updated port: 2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received event network-changed-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Refreshing instance network info cache due to event network-changed-2970e046-add1-4749-9206-0a5e9570298d. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] Acquiring lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Updating instance_info_cache with network_info: [{"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Instance network_info: |[{"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] Acquired lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Refreshing network info cache for port 2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:50:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Start _get_guest_xml network_info=[{"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:50:34 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:34 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:50:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1587903930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1587903930',id=32,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-676zrrgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:50:33Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=e2b743b9-0ec7-43a6-a18b-c72621c2cf60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f5:66,bridge_name='br-int',has_traffic_filtering=True,id=2970e046-add1-4749-9206-0a5e9570298d,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970e046-ad') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'pci_devices' on Instance uuid e2b743b9-0ec7-43a6-a18b-c72621c2cf60 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:50:35 user nova-compute[75203]:   <uuid>e2b743b9-0ec7-43a6-a18b-c72621c2cf60</uuid>
Nov 28 18:50:35 user nova-compute[75203]:   <name>instance-00000020</name>
Nov 28 18:50:35 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:50:35 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:50:35 user nova-compute[75203]:   <metadata>
Nov 28 18:50:35 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:50:35 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:50:35 user nova-compute[75203]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1587903930</nova:name>
Nov 28 18:50:35 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:50:34</nova:creationTime>
Nov 28 18:50:35 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:50:35 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:50:35 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:50:35 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:50:35 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:50:35 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:50:35 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:50:35 user nova-compute[75203]:       <nova:owner>
Nov 28 18:50:35 user nova-compute[75203]:         <nova:user uuid="ad9a9772df954da0b42b5b102440c1d0">tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member</nova:user>
Nov 28 18:50:35 user nova-compute[75203]:         <nova:project uuid="eec1aaec341d441fb4da4fc53a985617">tempest-ServerBootFromVolumeStableRescueTest-1173209255</nova:project>
Nov 28 18:50:35 user nova-compute[75203]:       </nova:owner>
Nov 28 18:50:35 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:50:35 user nova-compute[75203]:       <nova:ports>
Nov 28 18:50:35 user nova-compute[75203]:         <nova:port uuid="2970e046-add1-4749-9206-0a5e9570298d">
Nov 28 18:50:35 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 18:50:35 user nova-compute[75203]:         </nova:port>
Nov 28 18:50:35 user nova-compute[75203]:       </nova:ports>
Nov 28 18:50:35 user nova-compute[75203]:     </nova:instance>
Nov 28 18:50:35 user nova-compute[75203]:   </metadata>
Nov 28 18:50:35 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:50:35 user nova-compute[75203]:     <system>
Nov 28 18:50:35 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:50:35 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:50:35 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:50:35 user nova-compute[75203]:       <entry name="serial">e2b743b9-0ec7-43a6-a18b-c72621c2cf60</entry>
Nov 28 18:50:35 user nova-compute[75203]:       <entry name="uuid">e2b743b9-0ec7-43a6-a18b-c72621c2cf60</entry>
Nov 28 18:50:35 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:50:35 user nova-compute[75203]:     </system>
Nov 28 18:50:35 user nova-compute[75203]:   </sysinfo>
Nov 28 18:50:35 user nova-compute[75203]:   <os>
Nov 28 18:50:35 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:50:35 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:50:35 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:50:35 user nova-compute[75203]:   </os>
Nov 28 18:50:35 user nova-compute[75203]:   <features>
Nov 28 18:50:35 user nova-compute[75203]:     <acpi/>
Nov 28 18:50:35 user nova-compute[75203]:     <apic/>
Nov 28 18:50:35 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:50:35 user nova-compute[75203]:   </features>
Nov 28 18:50:35 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:50:35 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:50:35 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:50:35 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:50:35 user nova-compute[75203]:   </clock>
Nov 28 18:50:35 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:50:35 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:50:35 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:50:35 user nova-compute[75203]:   </cpu>
Nov 28 18:50:35 user nova-compute[75203]:   <devices>
Nov 28 18:50:35 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:50:35 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:50:35 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk"/>
Nov 28 18:50:35 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:50:35 user nova-compute[75203]:     </disk>
Nov 28 18:50:35 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:50:35 user nova-compute[75203]:       <mac address="fa:16:3e:9e:f5:66"/>
Nov 28 18:50:35 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:50:35 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:50:35 user nova-compute[75203]:       <target dev="tap2970e046-ad"/>
Nov 28 18:50:35 user nova-compute[75203]:     </interface>
Nov 28 18:50:35 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:50:35 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/console.log" append="off"/>
Nov 28 18:50:35 user nova-compute[75203]:     </serial>
Nov 28 18:50:35 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:50:35 user nova-compute[75203]:     <video>
Nov 28 18:50:35 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:50:35 user nova-compute[75203]:     </video>
Nov 28 18:50:35 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:50:35 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:50:35 user nova-compute[75203]:     </rng>
Nov 28 18:50:35 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:50:35 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:50:35 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:50:35 user nova-compute[75203]:     </memballoon>
Nov 28 18:50:35 user nova-compute[75203]:   </devices>
Nov 28 18:50:35 user nova-compute[75203]: </domain>
Nov 28 18:50:35 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:50:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1587903930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1587903930',id=32,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-676zrrgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:50:33Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=e2b743b9-0ec7-43a6-a18b-c72621c2cf60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f5:66,bridge_name='br-int',has_traffic_filtering=True,id=2970e046-add1-4749-9206-0a5e9570298d,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970e046-ad') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG os_vif [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f5:66,bridge_name='br-int',has_traffic_filtering=True,id=2970e046-add1-4749-9206-0a5e9570298d,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970e046-ad') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e493445-a061-5cd5-89db-4a65b6ac7efc', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2970e046-ad, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2970e046-ad, col_values=(('qos', UUID('1731614e-6227-48f7-8514-f65cea6c0504')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2970e046-ad, col_values=(('external_ids', {'iface-id': '2970e046-add1-4749-9206-0a5e9570298d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:f5:66', 'vm-uuid': 'e2b743b9-0ec7-43a6-a18b-c72621c2cf60'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:35 user nova-compute[75203]: INFO os_vif [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f5:66,bridge_name='br-int',has_traffic_filtering=True,id=2970e046-add1-4749-9206-0a5e9570298d,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970e046-ad')
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No VIF found with MAC fa:16:3e:9e:f5:66, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Updated VIF entry in instance network info cache for port 2970e046-add1-4749-9206-0a5e9570298d. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Updating instance_info_cache with network_info: [{"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8b8154f1-1b34-4a96-8056-3f4cb56e42e6 req-2a4b65e1-fd05-459d-b92f-9bb3270ad890 service nova] Releasing lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-1b26dca2-7155-4040-9185-519fd4a09879 req-6118ab94-1c0d-40c6-83a3-1bdcce66e3b2 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received event network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1b26dca2-7155-4040-9185-519fd4a09879 req-6118ab94-1c0d-40c6-83a3-1bdcce66e3b2 service nova] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1b26dca2-7155-4040-9185-519fd4a09879 req-6118ab94-1c0d-40c6-83a3-1bdcce66e3b2 service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1b26dca2-7155-4040-9185-519fd4a09879 req-6118ab94-1c0d-40c6-83a3-1bdcce66e3b2 service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-1b26dca2-7155-4040-9185-519fd4a09879 req-6118ab94-1c0d-40c6-83a3-1bdcce66e3b2 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] No waiting events found dispatching network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:36 user nova-compute[75203]: WARNING nova.compute.manager [req-1b26dca2-7155-4040-9185-519fd4a09879 req-6118ab94-1c0d-40c6-83a3-1bdcce66e3b2 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received unexpected event network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d for instance with vm_state building and task_state spawning.
Nov 28 18:50:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:50:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Instance spawned successfully.
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:50:38 user nova-compute[75203]: INFO nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-de1c7610-4ab9-40f0-85ae-84431ef86e27 req-e3b9f411-15be-4a6f-96eb-08f01e5e664f service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received event network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de1c7610-4ab9-40f0-85ae-84431ef86e27 req-e3b9f411-15be-4a6f-96eb-08f01e5e664f service nova] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de1c7610-4ab9-40f0-85ae-84431ef86e27 req-e3b9f411-15be-4a6f-96eb-08f01e5e664f service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-de1c7610-4ab9-40f0-85ae-84431ef86e27 req-e3b9f411-15be-4a6f-96eb-08f01e5e664f service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-de1c7610-4ab9-40f0-85ae-84431ef86e27 req-e3b9f411-15be-4a6f-96eb-08f01e5e664f service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] No waiting events found dispatching network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:38 user nova-compute[75203]: WARNING nova.compute.manager [req-de1c7610-4ab9-40f0-85ae-84431ef86e27 req-e3b9f411-15be-4a6f-96eb-08f01e5e664f service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received unexpected event network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d for instance with vm_state building and task_state spawning.
Nov 28 18:50:38 user nova-compute[75203]: INFO nova.compute.manager [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Took 6.35 seconds to build instance.
Nov 28 18:50:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d3c1d53-15b8-4e1d-b0e2-a787f6612b3a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.522s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:39 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 18:50:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 18:50:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:50:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:50:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:50 user nova-compute[75203]: INFO nova.compute.manager [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Terminating instance
Nov 28 18:50:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-c74e31f1-084c-463f-a61f-b27b7f45496c req-7783d103-3c46-4cff-8d48-557e38b685b2 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-unplugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c74e31f1-084c-463f-a61f-b27b7f45496c req-7783d103-3c46-4cff-8d48-557e38b685b2 service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c74e31f1-084c-463f-a61f-b27b7f45496c req-7783d103-3c46-4cff-8d48-557e38b685b2 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c74e31f1-084c-463f-a61f-b27b7f45496c req-7783d103-3c46-4cff-8d48-557e38b685b2 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-c74e31f1-084c-463f-a61f-b27b7f45496c req-7783d103-3c46-4cff-8d48-557e38b685b2 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-unplugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-c74e31f1-084c-463f-a61f-b27b7f45496c req-7783d103-3c46-4cff-8d48-557e38b685b2 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-unplugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Instance destroyed successfully.
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'resources' on Instance uuid 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1112017727',display_name='tempest-ServerRescueNegativeTestJSON-server-1112017727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1112017727',id=3,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-39ifyl7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:36:42Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=017ccf79-0df6-4fb7-a551-0b67f8e6afe3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "address": "fa:16:3e:f4:cf:2b", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a48b3f-3c", "ovs_interfaceid": "e4a48b3f-3cd4-47b0-afa2-57e955dceeff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG os_vif [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4a48b3f-3c, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=822e4f53-dc5b-40f7-9f73-79be8b9a30ca) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:51 user nova-compute[75203]: INFO os_vif [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:2b,bridge_name='br-int',has_traffic_filtering=True,id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a48b3f-3c')
Nov 28 18:50:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Deleting instance files /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3_del
Nov 28 18:50:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Deletion of /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3_del complete
Nov 28 18:50:51 user nova-compute[75203]: INFO nova.compute.manager [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json" returned: 1 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue --force-share --output=json' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:50:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000003, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/017ccf79-0df6-4fb7-a551-0b67f8e6afe3/disk.rescue
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-706a6e64-1b6b-4430-b825-3bc777286ea3 req-ef237db5-a094-4309-a33b-15fa4e2c93bc service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-deleted-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:51 user nova-compute[75203]: INFO nova.compute.manager [req-706a6e64-1b6b-4430-b825-3bc777286ea3 req-ef237db5-a094-4309-a33b-15fa4e2c93bc service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Neutron deleted interface e4a48b3f-3cd4-47b0-afa2-57e955dceeff; detaching it from the instance and deleting it from the info cache
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.network.neutron [req-706a6e64-1b6b-4430-b825-3bc777286ea3 req-ef237db5-a094-4309-a33b-15fa4e2c93bc service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:51 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Took 0.42 seconds to deallocate network for instance.
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-706a6e64-1b6b-4430-b825-3bc777286ea3 req-ef237db5-a094-4309-a33b-15fa4e2c93bc service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Detach interface failed, port_id=e4a48b3f-3cd4-47b0-afa2-57e955dceeff, reason: Instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 18:50:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:52 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=24.94513702392578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-1106c501-f0e3-4842-9348-7acf672062a9 req-63af76e6-58f7-40f1-b9b1-b29f07dddfb8 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1106c501-f0e3-4842-9348-7acf672062a9 req-63af76e6-58f7-40f1-b9b1-b29f07dddfb8 service nova] Acquiring lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1106c501-f0e3-4842-9348-7acf672062a9 req-63af76e6-58f7-40f1-b9b1-b29f07dddfb8 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1106c501-f0e3-4842-9348-7acf672062a9 req-63af76e6-58f7-40f1-b9b1-b29f07dddfb8 service nova] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-1106c501-f0e3-4842-9348-7acf672062a9 req-63af76e6-58f7-40f1-b9b1-b29f07dddfb8 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] No waiting events found dispatching network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:50:52 user nova-compute[75203]: WARNING nova.compute.manager [req-1106c501-f0e3-4842-9348-7acf672062a9 req-63af76e6-58f7-40f1-b9b1-b29f07dddfb8 service nova] [instance: 017ccf79-0df6-4fb7-a551-0b67f8e6afe3] Received unexpected event network-vif-plugged-e4a48b3f-3cd4-47b0-afa2-57e955dceeff for instance with vm_state deleted and task_state None.
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.929s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.467s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:50:52 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Deleted allocations for instance 017ccf79-0df6-4fb7-a551-0b67f8e6afe3
Nov 28 18:50:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-247dffa5-d269-4ab0-ab64-edca73072ab5 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "017ccf79-0df6-4fb7-a551-0b67f8e6afe3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.572s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b61c9405-587d-4b45-9641-7b1e2d73475a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 46065496-7151-4f16-a253-9b62f48ad5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b3650574-c55d-4b95-8dbf-7e884acbfccf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 687fe1ad-9990-4c9c-8c77-f2210c780df8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:50:52 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:50:53 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:50:53 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:50:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:50:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:50:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 18:50:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [{"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-4382dd69-a9f8-45a8-ae99-78d295cb606f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:50:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:50:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_power_states {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 4382dd69-a9f8-45a8-ae99-78d295cb606f {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid e170916d-ac84-400b-96b6-62d4b5919980 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid cf87ffa2-f1e7-49c1-8b09-51a5d080b652 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid b61c9405-587d-4b45-9641-7b1e2d73475a {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 46065496-7151-4f16-a253-9b62f48ad5c1 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid b3650574-c55d-4b95-8dbf-7e884acbfccf {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 687fe1ad-9990-4c9c-8c77-f2210c780df8 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid e2b743b9-0ec7-43a6-a18b-c72621c2cf60 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "e170916d-ac84-400b-96b6-62d4b5919980" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "e170916d-ac84-400b-96b6-62d4b5919980" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-changed-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Refreshing instance network info cache due to event network-changed-15b2ad33-078c-4923-9d9d-6eb013e0aac5. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] Acquiring lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] Acquired lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG nova.network.neutron [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Refreshing network info cache for port 15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG nova.objects.instance [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'flavor' on Instance uuid 46065496-7151-4f16-a253-9b62f48ad5c1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:51:31 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Ignoring supplied device name: /dev/vdb
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG nova.network.neutron [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Updated VIF entry in instance network info cache for port 15b2ad33-078c-4923-9d9d-6eb013e0aac5. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG nova.network.neutron [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Updating instance_info_cache with network_info: [{"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:31 user nova-compute[75203]: INFO nova.compute.manager [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Attaching volume 311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 to /dev/vdb
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ab3ee92-0732-4a64-96f4-052d1a543c74 req-9d23c39b-2d9c-4bf6-890a-1f5c82e2b53a service nova] Releasing lock "refresh_cache-46065496-7151-4f16-a253-9b62f48ad5c1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG os_brick.utils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ec156d-f056-4066-9e17-550516e5684b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27840bc-97c0-4071-ae64-b3214e3ca004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[67092ee2-0228-4305-8e09-c93b933ad65f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c0a8c0-ea64-4d69-883b-7536f0b92318]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:51:31 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:51:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2c9a32-dc4b-4269-828c-53c327e88a6b]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG os_brick.utils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:51:31 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Updating existing volume attachment record: 4379c758-0d9e-4161-85c9-d67858a9b227 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:51:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing instance network info cache due to event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbYKVDEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:51:38 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:51:38 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:51:38 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c267fac-e244-4174-b112-a23795667b9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:51:38 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd38ebf-42ba-484c-bf2f-0236689369e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42] added
Nov 28 18:51:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[790184b2-56fe-4be4-ba25-c4f8752b4d6e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[220b0033-87f9-482a-ae44-37d73946cc12]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbYKVDEO {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbYKVDEO" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b16b7-c5e7-4a76-aff9-11473c7d7e76]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbYKVDEO'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[90310b40-36bc-45b0-bce5-e8fe45c7bf98]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e911cb-be79-4a53-a3dd-14d11e66110e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:51:38 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:51:38 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:51:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:51:38 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:51:38 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:51:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae39b4c2-57bf-4b5e-b86e-f0503b5329df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260]
Nov 28 18:51:38 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260] successful.
Nov 28 18:51:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30458f8-bd52-4f16-88c3-7e5cf5f2796c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:51:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a62caac-9a35-4e1e-9ab8-268549c9ed58]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:51:39 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:51:39 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:51:39 user nova-compute[75203]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 (non-flash)
Nov 28 18:51:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:51:39 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:51:39 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:51:39 user nova-compute[75203]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 (non-flash)
Nov 28 18:51:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updated VIF entry in instance network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3296eca5-ff48-475c-96f1-e7fbeddfbda5 req-e077370c-a2aa-437d-b097-0118fc4f24c2 service nova] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[785aa02d-ba50-4cd1-8984-4a0e1ce7e3a2]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbYKVDEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:51:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:51:39 user nova-compute[75203]: INFO nova.compute.manager [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] instance snapshotting
Nov 28 18:51:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Beginning live snapshot process
Nov 28 18:51:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23537326534333261', 'path': '/dev/sde'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537326534333261', 'path': '/dev/sde'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG nova.objects.instance [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'flavor' on Instance uuid 46065496-7151-4f16-a253-9b62f48ad5c1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:51:40 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:51:40 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:51:40 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:51:40 user nova-compute[75203]:   <serial>311d0188-6bc2-4a42-ac7f-ce54fc2a7c42</serial>
Nov 28 18:51:40 user nova-compute[75203]: </disk>
Nov 28 18:51:40 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpivhjf5go/adedaf1e93914250ba40de2ce60d8a0b.delta 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpivhjf5go/adedaf1e93914250ba40de2ce60d8a0b.delta 1073741824" returned: 0 in 0.047s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 18:51:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No VIF found with MAC fa:16:3e:27:b9:f2, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-3853dfd5-dabd-4bcc-9378-c030581cf63b tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.173s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:40 user nova-compute[75203]: INFO nova.compute.manager [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Terminating instance
Nov 28 18:51:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-66fed914-9965-4660-842d-3cab7d1a2812 req-a3afb70e-acaa-4696-a75f-ed293e59d1cc service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-66fed914-9965-4660-842d-3cab7d1a2812 req-a3afb70e-acaa-4696-a75f-ed293e59d1cc service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-66fed914-9965-4660-842d-3cab7d1a2812 req-a3afb70e-acaa-4696-a75f-ed293e59d1cc service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-66fed914-9965-4660-842d-3cab7d1a2812 req-a3afb70e-acaa-4696-a75f-ed293e59d1cc service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-66fed914-9965-4660-842d-3cab7d1a2812 req-a3afb70e-acaa-4696-a75f-ed293e59d1cc service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-66fed914-9965-4660-842d-3cab7d1a2812 req-a3afb70e-acaa-4696-a75f-ed293e59d1cc service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-unplugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Instance destroyed successfully.
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lazy-loading 'resources' on Instance uuid fafd72ff-f097-4605-b7d5-c4d68ca082dc {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-681958282',display_name='tempest-ServerRescueNegativeTestJSON-server-681958282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-681958282',id=2,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:39:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d19b759f9948c9be9be5097069099b',ramdisk_id='',reservation_id='r-6bb15uyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2096861107',owner_user_name='tempest-ServerRescueNegativeTestJSON-2096861107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:41:25Z,user_data=None,user_id='f96761cb11ad45b0bbc9a0435d3c0324',uuid=fafd72ff-f097-4605-b7d5-c4d68ca082dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converting VIF {"id": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "address": "fa:16:3e:9f:e1:f0", "network": {"id": "5c9bd025-e274-4fb7-a9ed-562951f972ef", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843277904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d19b759f9948c9be9be5097069099b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a39e18-8e", "ovs_interfaceid": "26a39e18-8e9a-4f09-93f5-bc59364ca68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG os_vif [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26a39e18-8e, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=034dd77d-6518-4db1-97ed-0113fbe448f3) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:41 user nova-compute[75203]: INFO os_vif [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e1:f0,bridge_name='br-int',has_traffic_filtering=True,id=26a39e18-8e9a-4f09-93f5-bc59364ca68e,network=Network(5c9bd025-e274-4fb7-a9ed-562951f972ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a39e18-8e')
Nov 28 18:51:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Deleting instance files /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc_del
Nov 28 18:51:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Deletion of /opt/stack/data/nova/instances/fafd72ff-f097-4605-b7d5-c4d68ca082dc_del complete
Nov 28 18:51:41 user nova-compute[75203]: INFO nova.compute.manager [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 18:51:41 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:51:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 18:51:41 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:51:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpivhjf5go/adedaf1e93914250ba40de2ce60d8a0b.delta /opt/stack/data/nova/instances/snapshots/tmpivhjf5go/adedaf1e93914250ba40de2ce60d8a0b {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-26b20ac2-7661-48e8-bb67-4140d7837327 req-c08bb689-114b-4f87-a1d4-08afdaa48422 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-deleted-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:42 user nova-compute[75203]: INFO nova.compute.manager [req-26b20ac2-7661-48e8-bb67-4140d7837327 req-c08bb689-114b-4f87-a1d4-08afdaa48422 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Neutron deleted interface 26a39e18-8e9a-4f09-93f5-bc59364ca68e; detaching it from the instance and deleting it from the info cache
Nov 28 18:51:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-26b20ac2-7661-48e8-bb67-4140d7837327 req-c08bb689-114b-4f87-a1d4-08afdaa48422 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:42 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Took 0.68 seconds to deallocate network for instance.
Nov 28 18:51:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-26b20ac2-7661-48e8-bb67-4140d7837327 req-c08bb689-114b-4f87-a1d4-08afdaa48422 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Detach interface failed, port_id=26a39e18-8e9a-4f09-93f5-bc59364ca68e, reason: Instance fafd72ff-f097-4605-b7d5-c4d68ca082dc could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpivhjf5go/adedaf1e93914250ba40de2ce60d8a0b.delta /opt/stack/data/nova/instances/snapshots/tmpivhjf5go/adedaf1e93914250ba40de2ce60d8a0b" returned: 0 in 0.765s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Snapshot extracted, beginning image upload
Nov 28 18:51:42 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:51:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:43 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Deleted allocations for instance fafd72ff-f097-4605-b7d5-c4d68ca082dc
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d964d7ee-d093-4c24-a7f0-d819899b96f0 tempest-ServerRescueNegativeTestJSON-2096861107 tempest-ServerRescueNegativeTestJSON-2096861107-project-member] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:43 user nova-compute[75203]: WARNING nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state deleted and task_state None.
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:43 user nova-compute[75203]: WARNING nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state deleted and task_state None.
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:43 user nova-compute[75203]: WARNING nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state deleted and task_state None.
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Acquiring lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] Lock "fafd72ff-f097-4605-b7d5-c4d68ca082dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] No waiting events found dispatching network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:43 user nova-compute[75203]: WARNING nova.compute.manager [req-61746138-11f3-49c5-8ca5-debf6325bf75 req-653c1a6e-f739-46a0-9b5b-f6334bc9d0d5 service nova] [instance: fafd72ff-f097-4605-b7d5-c4d68ca082dc] Received unexpected event network-vif-plugged-26a39e18-8e9a-4f09-93f5-bc59364ca68e for instance with vm_state deleted and task_state None.
Nov 28 18:51:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:45 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Snapshot image upload complete
Nov 28 18:51:45 user nova-compute[75203]: INFO nova.compute.manager [None req-059619d9-c7f7-4d9b-b36b-0404597286bb tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Took 5.97 seconds to snapshot the instance on the hypervisor.
Nov 28 18:51:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:47 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:47 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:51:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:49 user nova-compute[75203]: INFO nova.compute.manager [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Terminating instance
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-9a91ffa8-a676-4744-9b49-dfec04a8a364 req-8d3d0d3f-f544-40b0-9261-6999361a7efc service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received event network-vif-unplugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9a91ffa8-a676-4744-9b49-dfec04a8a364 req-8d3d0d3f-f544-40b0-9261-6999361a7efc service nova] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9a91ffa8-a676-4744-9b49-dfec04a8a364 req-8d3d0d3f-f544-40b0-9261-6999361a7efc service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9a91ffa8-a676-4744-9b49-dfec04a8a364 req-8d3d0d3f-f544-40b0-9261-6999361a7efc service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-9a91ffa8-a676-4744-9b49-dfec04a8a364 req-8d3d0d3f-f544-40b0-9261-6999361a7efc service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] No waiting events found dispatching network-vif-unplugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-9a91ffa8-a676-4744-9b49-dfec04a8a364 req-8d3d0d3f-f544-40b0-9261-6999361a7efc service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received event network-vif-unplugged-476f9a19-4f47-426f-8653-1d74368f6c73 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Instance destroyed successfully.
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lazy-loading 'resources' on Instance uuid b3650574-c55d-4b95-8dbf-7e884acbfccf {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-568471815',display_name='tempest-VolumesNegativeTest-instance-568471815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-568471815',id=30,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0360ef8662aa453197be485b3c4a1c33',ramdisk_id='',reservation_id='r-xwe3k3aj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1649454180',owner_user_name='tempest-VolumesNegativeTest-1649454180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:50:06Z,user_data=None,user_id='33f323fd910b4786931b7eb264db9da2',uuid=b3650574-c55d-4b95-8dbf-7e884acbfccf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Converting VIF {"id": "476f9a19-4f47-426f-8653-1d74368f6c73", "address": "fa:16:3e:be:7d:81", "network": {"id": "02c47140-88dd-480c-95af-54e10276b8eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6314a56936bd44e8891984d3a2469aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap476f9a19-4f", "ovs_interfaceid": "476f9a19-4f47-426f-8653-1d74368f6c73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:7d:81,bridge_name='br-int',has_traffic_filtering=True,id=476f9a19-4f47-426f-8653-1d74368f6c73,network=Network(02c47140-88dd-480c-95af-54e10276b8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap476f9a19-4f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG os_vif [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:7d:81,bridge_name='br-int',has_traffic_filtering=True,id=476f9a19-4f47-426f-8653-1d74368f6c73,network=Network(02c47140-88dd-480c-95af-54e10276b8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap476f9a19-4f') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap476f9a19-4f, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a4dd303-2463-4a44-8652-4151f612acd6) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:51:49 user nova-compute[75203]: INFO os_vif [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:7d:81,bridge_name='br-int',has_traffic_filtering=True,id=476f9a19-4f47-426f-8653-1d74368f6c73,network=Network(02c47140-88dd-480c-95af-54e10276b8eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap476f9a19-4f')
Nov 28 18:51:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Deleting instance files /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf_del
Nov 28 18:51:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Deletion of /opt/stack/data/nova/instances/b3650574-c55d-4b95-8dbf-7e884acbfccf_del complete
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:49 user nova-compute[75203]: INFO nova.compute.manager [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 28 18:51:49 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:51:49 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:50 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Took 0.52 seconds to deallocate network for instance.
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:50 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Error from libvirt while getting description of instance-0000001e: [Error Code 42] Domain not found: no domain with matching uuid 'b3650574-c55d-4b95-8dbf-7e884acbfccf' (instance-0000001e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b3650574-c55d-4b95-8dbf-7e884acbfccf' (instance-0000001e)
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:51:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.766s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:51:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=24.92321014404297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:51 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Deleted allocations for instance b3650574-c55d-4b95-8dbf-7e884acbfccf
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78abee2d-e180-4efc-bbf5-9122acd06cc5 tempest-VolumesNegativeTest-1649454180 tempest-VolumesNegativeTest-1649454180-project-member] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-f1646a35-b17a-4bd0-8eb0-a1c30db29648 req-66f1e3c6-07ae-4dc0-9812-dfff3ece10fc service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received event network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f1646a35-b17a-4bd0-8eb0-a1c30db29648 req-66f1e3c6-07ae-4dc0-9812-dfff3ece10fc service nova] Acquiring lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f1646a35-b17a-4bd0-8eb0-a1c30db29648 req-66f1e3c6-07ae-4dc0-9812-dfff3ece10fc service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f1646a35-b17a-4bd0-8eb0-a1c30db29648 req-66f1e3c6-07ae-4dc0-9812-dfff3ece10fc service nova] Lock "b3650574-c55d-4b95-8dbf-7e884acbfccf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-f1646a35-b17a-4bd0-8eb0-a1c30db29648 req-66f1e3c6-07ae-4dc0-9812-dfff3ece10fc service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] No waiting events found dispatching network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:51 user nova-compute[75203]: WARNING nova.compute.manager [req-f1646a35-b17a-4bd0-8eb0-a1c30db29648 req-66f1e3c6-07ae-4dc0-9812-dfff3ece10fc service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received unexpected event network-vif-plugged-476f9a19-4f47-426f-8653-1d74368f6c73 for instance with vm_state deleted and task_state None.
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-f1646a35-b17a-4bd0-8eb0-a1c30db29648 req-66f1e3c6-07ae-4dc0-9812-dfff3ece10fc service nova] [instance: b3650574-c55d-4b95-8dbf-7e884acbfccf] Received event network-vif-deleted-476f9a19-4f47-426f-8653-1d74368f6c73 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b61c9405-587d-4b45-9641-7b1e2d73475a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 46065496-7151-4f16-a253-9b62f48ad5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 687fe1ad-9990-4c9c-8c77-f2210c780df8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:51:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-changed-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Refreshing instance network info cache due to event network-changed-66a2b0a4-209a-4675-a026-24da8e88ed3f. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] Acquiring lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] Acquired lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:51:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Refreshing network info cache for port 66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:53 user nova-compute[75203]: INFO nova.compute.manager [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Terminating instance
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Updated VIF entry in instance network info cache for port 66a2b0a4-209a-4675-a026-24da8e88ed3f. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Updating instance_info_cache with network_info: [{"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0e106d29-6d4f-4a9c-9dbb-83673efa7d3d req-0593d2f2-6b14-4172-9ae2-988137012755 service nova] Releasing lock "refresh_cache-687fe1ad-9990-4c9c-8c77-f2210c780df8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:53 user nova-compute[75203]: INFO nova.compute.manager [None req-931e9204-e245-46a3-b19f-bd271d30e976 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Get console output
Nov 28 18:51:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1a9680-c6d2-4b3e-9c9a-5049e1837f05 req-c3158419-dd18-4438-a6b2-c007612cd62d service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-vif-unplugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1a9680-c6d2-4b3e-9c9a-5049e1837f05 req-c3158419-dd18-4438-a6b2-c007612cd62d service nova] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1a9680-c6d2-4b3e-9c9a-5049e1837f05 req-c3158419-dd18-4438-a6b2-c007612cd62d service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-dd1a9680-c6d2-4b3e-9c9a-5049e1837f05 req-c3158419-dd18-4438-a6b2-c007612cd62d service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1a9680-c6d2-4b3e-9c9a-5049e1837f05 req-c3158419-dd18-4438-a6b2-c007612cd62d service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] No waiting events found dispatching network-vif-unplugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-dd1a9680-c6d2-4b3e-9c9a-5049e1837f05 req-c3158419-dd18-4438-a6b2-c007612cd62d service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-vif-unplugged-66a2b0a4-209a-4675-a026-24da8e88ed3f for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:51:53 user nova-compute[75203]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 28 18:51:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:51:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:51:54 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Instance destroyed successfully.
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.objects.instance [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'resources' on Instance uuid 687fe1ad-9990-4c9c-8c77-f2210c780df8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-167849791',display_name='tempest-AttachVolumeNegativeTest-server-167849791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-167849791',id=31,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVtUHUN0MR2UCGB2gqLrPFzQIRVgl4rmMRnuo6pYChJFmfGIyoILvMX0y+m34YoVP4k1EW9WFQPB/lhvU+vfyvusguKRcvRbHKW1FjDu0iAPLnIJevE8zD6p/szCmV2Sg==',key_name='tempest-keypair-1556149755',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:50:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-988631he',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=687fe1ad-9990-4c9c-8c77-f2210c780df8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "address": "fa:16:3e:5a:cd:51", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2b0a4-20", "ovs_interfaceid": "66a2b0a4-209a-4675-a026-24da8e88ed3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:51,bridge_name='br-int',has_traffic_filtering=True,id=66a2b0a4-209a-4675-a026-24da8e88ed3f,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2b0a4-20') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG os_vif [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:51,bridge_name='br-int',has_traffic_filtering=True,id=66a2b0a4-209a-4675-a026-24da8e88ed3f,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2b0a4-20') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66a2b0a4-20, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95041a97-9602-4838-8e4e-fbfdfcaab188) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:51:54 user nova-compute[75203]: INFO os_vif [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cd:51,bridge_name='br-int',has_traffic_filtering=True,id=66a2b0a4-209a-4675-a026-24da8e88ed3f,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2b0a4-20')
Nov 28 18:51:54 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Deleting instance files /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8_del
Nov 28 18:51:54 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Deletion of /opt/stack/data/nova/instances/687fe1ad-9990-4c9c-8c77-f2210c780df8_del complete
Nov 28 18:51:54 user nova-compute[75203]: INFO nova.compute.manager [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 28 18:51:54 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:51:54 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Took 0.74 seconds to deallocate network for instance.
Nov 28 18:51:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-80552b49-f5f6-448f-a781-e79e8232b523 req-4f888253-9290-48b9-b2a0-99e2671c82d0 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-vif-deleted-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:55 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Deleted allocations for instance 687fe1ad-9990-4c9c-8c77-f2210c780df8
Nov 28 18:51:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-94bfb579-41c7-402f-8608-f0fa910b42b9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-0862f026-3626-42c5-9dc4-2ee7aab0edae req-1b0fa4d2-5b12-4cad-aacd-8d3eeaaff598 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received event network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0862f026-3626-42c5-9dc4-2ee7aab0edae req-1b0fa4d2-5b12-4cad-aacd-8d3eeaaff598 service nova] Acquiring lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0862f026-3626-42c5-9dc4-2ee7aab0edae req-1b0fa4d2-5b12-4cad-aacd-8d3eeaaff598 service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0862f026-3626-42c5-9dc4-2ee7aab0edae req-1b0fa4d2-5b12-4cad-aacd-8d3eeaaff598 service nova] Lock "687fe1ad-9990-4c9c-8c77-f2210c780df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:51:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-0862f026-3626-42c5-9dc4-2ee7aab0edae req-1b0fa4d2-5b12-4cad-aacd-8d3eeaaff598 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] No waiting events found dispatching network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:51:55 user nova-compute[75203]: WARNING nova.compute.manager [req-0862f026-3626-42c5-9dc4-2ee7aab0edae req-1b0fa4d2-5b12-4cad-aacd-8d3eeaaff598 service nova] [instance: 687fe1ad-9990-4c9c-8c77-f2210c780df8] Received unexpected event network-vif-plugged-66a2b0a4-209a-4675-a026-24da8e88ed3f for instance with vm_state deleted and task_state None.
Nov 28 18:51:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:51:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:51:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:01 user nova-compute[75203]: INFO nova.compute.manager [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Detaching volume 311d0188-6bc2-4a42-ac7f-ce54fc2a7c42
Nov 28 18:52:01 user nova-compute[75203]: INFO nova.virt.block_device [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Attempting to driver detach volume 311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 from mountpoint /dev/vdb
Nov 28 18:52:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Attempting to detach device vdb from instance 46065496-7151-4f16-a253-9b62f48ad5c1 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:52:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:52:01 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:52:01 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:52:01 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:52:01 user nova-compute[75203]:   <serial>311d0188-6bc2-4a42-ac7f-ce54fc2a7c42</serial>
Nov 28 18:52:01 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:52:01 user nova-compute[75203]: </disk>
Nov 28 18:52:01 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:52:01 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully detached device vdb from instance 46065496-7151-4f16-a253-9b62f48ad5c1 from the persistent domain config.
Nov 28 18:52:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46065496-7151-4f16-a253-9b62f48ad5c1 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:52:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:52:01 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:52:01 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:52:01 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:52:01 user nova-compute[75203]:   <serial>311d0188-6bc2-4a42-ac7f-ce54fc2a7c42</serial>
Nov 28 18:52:01 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:52:01 user nova-compute[75203]: </disk>
Nov 28 18:52:01 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:52:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46065496-7151-4f16-a253-9b62f48ad5c1 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:52:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:21 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 46065496-7151-4f16-a253-9b62f48ad5c1 is timed out.
Nov 28 18:52:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully detached device vdb from instance 46065496-7151-4f16-a253-9b62f48ad5c1 from the live domain config.
Nov 28 18:52:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbYKVDEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:52:21 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2cd9fb-db78-4894-8607-56cf961998f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:52:21 user nova-compute[75203]: No targets found.
Nov 28 18:52:21 user nova-compute[75203]: iSNS:
Nov 28 18:52:21 user nova-compute[75203]: No targets found.
Nov 28 18:52:21 user nova-compute[75203]: STATIC:
Nov 28 18:52:21 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558
Nov 28 18:52:21 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:21 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:21 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:52:21 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:21 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:21 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469
Nov 28 18:52:21 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:21 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:21 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42
Nov 28 18:52:21 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:21 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:21 user nova-compute[75203]: FIRMWARE:
Nov 28 18:52:21 user nova-compute[75203]: No targets found.
Nov 28 18:52:21 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:52:21 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:52:21 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7db606-ae9a-4791-bb40-384b395f416c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c3b6de-bf0d-416b-a925-fdd9d428e1e5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:52:21 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:52:21 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:52:21 user nova-compute[75203]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 (non-flash)
Nov 28 18:52:21 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:52:21 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:52:21 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:52:21 user nova-compute[75203]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 (non-flash)
Nov 28 18:52:21 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790188af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42'): ({'sde'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Removing single pathed devices sde {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7e4afb-f15f-4ba8-8e37-b631adeab227]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[addc6056-77cb-4362-88c0-58cb442dea4f]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Flushing IO for device /dev/sde {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f3eb53-4691-4c8d-876e-79c0f13097a9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d05d6-e747-49ae-92cb-dabbee7ad474]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1500475-2545-4995-8d3f-d9103b5eeba3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912f775-cb9f-468c-8699-12aaef152ab8]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260]
Nov 28 18:52:21 user nova-compute[75203]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42, portal: 172.16.0.220,3260] successful.
Nov 28 18:52:21 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb3a24-cc55-4f78-9a8a-a90357fdfb15]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== disconnect_volume: return (328ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:52:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:52:22 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'flavor' on Instance uuid 46065496-7151-4f16-a253-9b62f48ad5c1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:52:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b4a0e0d8-819a-4aa7-b7f7-b58e3f7237d5 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.705s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:22 user nova-compute[75203]: INFO nova.compute.manager [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Terminating instance
Nov 28 18:52:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:52:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-f79cd46e-f911-4f38-ace7-b9803b8df9e6 req-59880ff0-dd11-4586-a3ad-4fec83605c0d service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-vif-unplugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f79cd46e-f911-4f38-ace7-b9803b8df9e6 req-59880ff0-dd11-4586-a3ad-4fec83605c0d service nova] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f79cd46e-f911-4f38-ace7-b9803b8df9e6 req-59880ff0-dd11-4586-a3ad-4fec83605c0d service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f79cd46e-f911-4f38-ace7-b9803b8df9e6 req-59880ff0-dd11-4586-a3ad-4fec83605c0d service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-f79cd46e-f911-4f38-ace7-b9803b8df9e6 req-59880ff0-dd11-4586-a3ad-4fec83605c0d service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] No waiting events found dispatching network-vif-unplugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-f79cd46e-f911-4f38-ace7-b9803b8df9e6 req-59880ff0-dd11-4586-a3ad-4fec83605c0d service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-vif-unplugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:52:23 user nova-compute[75203]: INFO nova.compute.manager [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] instance snapshotting
Nov 28 18:52:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Beginning live snapshot process
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Instance destroyed successfully.
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'resources' on Instance uuid 46065496-7151-4f16-a253-9b62f48ad5c1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1833440151',display_name='tempest-VolumesSnapshotTestJSON-instance-1833440151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1833440151',id=28,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodCmdngHU7DW4kSpECxbVLetzQQOVOcPCLA+wI0g7ihA3DpXVEqQQ4dV7tF3s0qxW+yJiy0+io0A2DZyHuKD5C04C9D7VlxkJS/0Hq5LFetVQ3LTi5tSP1hGxBAUj2AQ==',key_name='tempest-keypair-26863168',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8dc3f94308cd4b99871d9113d6516bfc',ramdisk_id='',reservation_id='r-08m8qcby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-926769811',owner_user_name='tempest-VolumesSnapshotTestJSON-926769811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8c1bccaa174d4da0865d55770703a2',uuid=46065496-7151-4f16-a253-9b62f48ad5c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converting VIF {"id": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "address": "fa:16:3e:27:b9:f2", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b2ad33-07", "ovs_interfaceid": "15b2ad33-078c-4923-9d9d-6eb013e0aac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=15b2ad33-078c-4923-9d9d-6eb013e0aac5,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b2ad33-07') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_vif [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=15b2ad33-078c-4923-9d9d-6eb013e0aac5,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b2ad33-07') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15b2ad33-07, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df13039b-5ce3-4fb4-ae8b-7e9285173601) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:23 user nova-compute[75203]: INFO os_vif [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:b9:f2,bridge_name='br-int',has_traffic_filtering=True,id=15b2ad33-078c-4923-9d9d-6eb013e0aac5,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b2ad33-07')
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbYKVDEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:52:23 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce75e6c-0260-4ca4-8c72-e15d89a7cd09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:52:23 user nova-compute[75203]: No targets found.
Nov 28 18:52:23 user nova-compute[75203]: iSNS:
Nov 28 18:52:23 user nova-compute[75203]: No targets found.
Nov 28 18:52:23 user nova-compute[75203]: STATIC:
Nov 28 18:52:23 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558
Nov 28 18:52:23 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:23 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:23 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:52:23 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:23 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:23 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469
Nov 28 18:52:23 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:23 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:23 user nova-compute[75203]: FIRMWARE:
Nov 28 18:52:23 user nova-compute[75203]: No targets found.
Nov 28 18:52:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:52:23 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:52:23 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:311d0188-6bc2-4a42-ac7f-ce54fc2a7c42', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[21266052-153b-4d70-90ab-8c533dd369a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b38e42d-5d29-4617-8cd3-fe445bafe1cf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:52:23 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:52:23 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:52:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:52:23 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:52:23 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:52:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a825f760>, {}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Disconnecting from: [] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== disconnect_volume: return (90ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:52:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Deleting instance files /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1_del
Nov 28 18:52:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Deletion of /opt/stack/data/nova/instances/46065496-7151-4f16-a253-9b62f48ad5c1_del complete
Nov 28 18:52:23 user nova-compute[75203]: INFO nova.compute.manager [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppq14nlo8/d267d67d88494821b12d0a1aff9b9898.delta 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppq14nlo8/d267d67d88494821b12d0a1aff9b9898.delta 1073741824" returned: 0 in 0.053s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 18:52:24 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:52:24 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Took 0.81 seconds to deallocate network for instance.
Nov 28 18:52:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-0fd13698-c352-454e-8988-aca228e786bd req-e84ece8f-d7b9-4cec-873b-4d4933fd4b14 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-vif-deleted-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:52:24 user nova-compute[75203]: WARNING nova.volume.cinder [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Attachment 4379c758-0d9e-4161-85c9-d67858a9b227 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4379c758-0d9e-4161-85c9-d67858a9b227. (HTTP 404) (Request-ID: req-09e560a7-079d-4320-9f17-5e69ca9eb709)
Nov 28 18:52:24 user nova-compute[75203]: INFO nova.compute.manager [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 18:52:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:25 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Deleted allocations for instance 46065496-7151-4f16-a253-9b62f48ad5c1
Nov 28 18:52:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1b2ec28b-cb34-42d8-bd36-a3c648fae459 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "46065496-7151-4f16-a253-9b62f48ad5c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-9db138ff-9859-47bf-86ea-c62d73c430cb req-2907890d-6c1b-403f-a8bb-2f3fc5940f19 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received event network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9db138ff-9859-47bf-86ea-c62d73c430cb req-2907890d-6c1b-403f-a8bb-2f3fc5940f19 service nova] Acquiring lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9db138ff-9859-47bf-86ea-c62d73c430cb req-2907890d-6c1b-403f-a8bb-2f3fc5940f19 service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9db138ff-9859-47bf-86ea-c62d73c430cb req-2907890d-6c1b-403f-a8bb-2f3fc5940f19 service nova] Lock "46065496-7151-4f16-a253-9b62f48ad5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-9db138ff-9859-47bf-86ea-c62d73c430cb req-2907890d-6c1b-403f-a8bb-2f3fc5940f19 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] No waiting events found dispatching network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:52:25 user nova-compute[75203]: WARNING nova.compute.manager [req-9db138ff-9859-47bf-86ea-c62d73c430cb req-2907890d-6c1b-403f-a8bb-2f3fc5940f19 service nova] [instance: 46065496-7151-4f16-a253-9b62f48ad5c1] Received unexpected event network-vif-plugged-15b2ad33-078c-4923-9d9d-6eb013e0aac5 for instance with vm_state deleted and task_state None.
Nov 28 18:52:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 18:52:25 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 18:52:25 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:52:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppq14nlo8/d267d67d88494821b12d0a1aff9b9898.delta /opt/stack/data/nova/instances/snapshots/tmppq14nlo8/d267d67d88494821b12d0a1aff9b9898 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppq14nlo8/d267d67d88494821b12d0a1aff9b9898.delta /opt/stack/data/nova/instances/snapshots/tmppq14nlo8/d267d67d88494821b12d0a1aff9b9898" returned: 0 in 0.394s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:26 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Snapshot extracted, beginning image upload
Nov 28 18:52:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Snapshot image upload complete
Nov 28 18:52:28 user nova-compute[75203]: INFO nova.compute.manager [None req-7d3ca9fb-44b3-458b-a43c-1aca6f33c4d1 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Took 5.17 seconds to snapshot the instance on the hypervisor.
Nov 28 18:52:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 18:52:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:52:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:52:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:44 user nova-compute[75203]: INFO nova.compute.manager [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Detaching volume 4e1bac3f-e5b9-481e-88ff-03c1b2847558
Nov 28 18:52:44 user nova-compute[75203]: INFO nova.virt.block_device [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Attempting to driver detach volume 4e1bac3f-e5b9-481e-88ff-03c1b2847558 from mountpoint /dev/vdb
Nov 28 18:52:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Attempting to detach device vdb from instance b61c9405-587d-4b45-9641-7b1e2d73475a from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:52:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:52:44 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:52:44 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:52:44 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:52:44 user nova-compute[75203]:   <serial>4e1bac3f-e5b9-481e-88ff-03c1b2847558</serial>
Nov 28 18:52:44 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:52:44 user nova-compute[75203]: </disk>
Nov 28 18:52:44 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:52:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully detached device vdb from instance b61c9405-587d-4b45-9641-7b1e2d73475a from the persistent domain config.
Nov 28 18:52:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b61c9405-587d-4b45-9641-7b1e2d73475a from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:52:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:52:44 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:52:44 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:52:44 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:52:44 user nova-compute[75203]:   <serial>4e1bac3f-e5b9-481e-88ff-03c1b2847558</serial>
Nov 28 18:52:44 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:52:44 user nova-compute[75203]: </disk>
Nov 28 18:52:44 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:52:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b61c9405-587d-4b45-9641-7b1e2d73475a {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:52:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:52:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:52:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:52:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8217MB free_disk=24.947566986083984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 4382dd69-a9f8-45a8-ae99-78d295cb606f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b61c9405-587d-4b45-9641-7b1e2d73475a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:52:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:52:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:54 user nova-compute[75203]: INFO nova.compute.manager [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Terminating instance
Nov 28 18:52:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-1cbbefcb-feb9-4e0a-8bc9-f9b7a2e0efc9 req-4f71278c-063c-41ad-9a9d-a3a8d045b5dc service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-unplugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1cbbefcb-feb9-4e0a-8bc9-f9b7a2e0efc9 req-4f71278c-063c-41ad-9a9d-a3a8d045b5dc service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1cbbefcb-feb9-4e0a-8bc9-f9b7a2e0efc9 req-4f71278c-063c-41ad-9a9d-a3a8d045b5dc service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1cbbefcb-feb9-4e0a-8bc9-f9b7a2e0efc9 req-4f71278c-063c-41ad-9a9d-a3a8d045b5dc service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-1cbbefcb-feb9-4e0a-8bc9-f9b7a2e0efc9 req-4f71278c-063c-41ad-9a9d-a3a8d045b5dc service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-unplugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-1cbbefcb-feb9-4e0a-8bc9-f9b7a2e0efc9 req-4f71278c-063c-41ad-9a9d-a3a8d045b5dc service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-unplugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Instance destroyed successfully.
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'resources' on Instance uuid cf87ffa2-f1e7-49c1-8b09-51a5d080b652 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1405371006',display_name='tempest-ServerActionsTestOtherA-server-1405371006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1405371006',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:48:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvxg74h9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=cf87ffa2-f1e7-49c1-8b09-51a5d080b652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "address": "fa:16:3e:95:b6:00", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef728cc-e4", "ovs_interfaceid": "0ef728cc-e4b3-4167-a71c-5f4e2b1a9663", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_vif [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ef728cc-e4, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfe3a99e-af8f-4966-a9ed-5edfe5cf2bcd) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:52:55 user nova-compute[75203]: INFO os_vif [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b6:00,bridge_name='br-int',has_traffic_filtering=True,id=0ef728cc-e4b3-4167-a71c-5f4e2b1a9663,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef728cc-e4')
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRkOCZbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:52:55 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27794ff-b8bd-4d54-8c04-b4a995cdc15a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:52:55 user nova-compute[75203]: No targets found.
Nov 28 18:52:55 user nova-compute[75203]: iSNS:
Nov 28 18:52:55 user nova-compute[75203]: No targets found.
Nov 28 18:52:55 user nova-compute[75203]: STATIC:
Nov 28 18:52:55 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558
Nov 28 18:52:55 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:55 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:55 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:52:55 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:55 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:55 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469
Nov 28 18:52:55 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:52:55 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:52:55 user nova-compute[75203]: FIRMWARE:
Nov 28 18:52:55 user nova-compute[75203]: No targets found.
Nov 28 18:52:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:52:55 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:52:55 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3b09d8-666a-42d4-8d40-1e8c2945e1c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f628d6-ee3f-473b-ad41-72f76082fef6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:52:55 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:52:55 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:52:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:52:55 user nova-compute[75203]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 (non-flash)
Nov 28 18:52:55 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:52:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07ac32d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469'): ({'sdd'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Removing single pathed devices sdd {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed558a7e-5639-42c9-89ca-3a4d6b97e727]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73b79e9-6d9c-40d4-b2aa-9db9099b22c5]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Flushing IO for device /dev/sdd {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7684f13-0968-491c-8306-6cb49c48c371]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0cdd1c-b943-4e48-9d89-8c6be12eb1fd]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08cba0e-1ad2-4995-9234-242ad3ab70f3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[515a8f59-35d4-481a-a95a-b852648a0c1c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260]
Nov 28 18:52:55 user nova-compute[75203]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469, portal: 172.16.0.220,3260] successful.
Nov 28 18:52:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b67fbfb-6046-411b-a722-dc8ec2537469 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[79537c94-7c52-4b02-9588-bfd26c83defc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] <== disconnect_volume: return (352ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:52:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Deleting instance files /opt/stack/data/nova/instances/cf87ffa2-f1e7-49c1-8b09-51a5d080b652_del
Nov 28 18:52:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Deletion of /opt/stack/data/nova/instances/cf87ffa2-f1e7-49c1-8b09-51a5d080b652_del complete
Nov 28 18:52:55 user nova-compute[75203]: INFO nova.compute.manager [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:52:55 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating instance_info_cache with network_info: [{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:52:56 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Took 0.89 seconds to deallocate network for instance.
Nov 28 18:52:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-4a67410f-f47f-445e-8c08-2ce10f541481 req-f23df5c4-75af-4a5f-9878-02787daa122c service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4a67410f-f47f-445e-8c08-2ce10f541481 req-f23df5c4-75af-4a5f-9878-02787daa122c service nova] Acquiring lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4a67410f-f47f-445e-8c08-2ce10f541481 req-f23df5c4-75af-4a5f-9878-02787daa122c service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4a67410f-f47f-445e-8c08-2ce10f541481 req-f23df5c4-75af-4a5f-9878-02787daa122c service nova] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-4a67410f-f47f-445e-8c08-2ce10f541481 req-f23df5c4-75af-4a5f-9878-02787daa122c service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] No waiting events found dispatching network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:52:56 user nova-compute[75203]: WARNING nova.compute.manager [req-4a67410f-f47f-445e-8c08-2ce10f541481 req-f23df5c4-75af-4a5f-9878-02787daa122c service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received unexpected event network-vif-plugged-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 for instance with vm_state active and task_state deleting.
Nov 28 18:52:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-4a67410f-f47f-445e-8c08-2ce10f541481 req-f23df5c4-75af-4a5f-9878-02787daa122c service nova] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Received event network-vif-deleted-0ef728cc-e4b3-4167-a71c-5f4e2b1a9663 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:52:57 user nova-compute[75203]: INFO nova.compute.manager [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Took 0.84 seconds to detach 1 volumes for instance.
Nov 28 18:52:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: cf87ffa2-f1e7-49c1-8b09-51a5d080b652] Deleting volume: 9b67fbfb-6046-411b-a722-dc8ec2537469 {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 18:52:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:52:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:52:57 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:52:57 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:52:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:52:57 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Deleted allocations for instance cf87ffa2-f1e7-49c1-8b09-51a5d080b652
Nov 28 18:52:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-65f29706-f34f-42cf-89a8-fc77e7e79886 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "cf87ffa2-f1e7-49c1-8b09-51a5d080b652" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.532s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:05 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b61c9405-587d-4b45-9641-7b1e2d73475a is timed out.
Nov 28 18:53:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully detached device vdb from instance b61c9405-587d-4b45-9641-7b1e2d73475a from the live domain config.
Nov 28 18:53:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpArJZFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:53:05 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba67e17b-38dc-4299-8043-5ea7676f1196]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:53:05 user nova-compute[75203]: No targets found.
Nov 28 18:53:05 user nova-compute[75203]: iSNS:
Nov 28 18:53:05 user nova-compute[75203]: No targets found.
Nov 28 18:53:05 user nova-compute[75203]: STATIC:
Nov 28 18:53:05 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558
Nov 28 18:53:05 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:53:05 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:53:05 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:53:05 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:53:05 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:53:05 user nova-compute[75203]: FIRMWARE:
Nov 28 18:53:05 user nova-compute[75203]: No targets found.
Nov 28 18:53:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:53:05 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:53:05 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f87396-0381-4709-8cc7-23f1572d0e61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2230f-758f-4fde-b29f-0327649a3512]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:05 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:53:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:05 user nova-compute[75203]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 (non-flash)
Nov 28 18:53:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903ca4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106c169-d0f5-45a9-9550-b4448a0481cb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72c95f9-8598-4767-ba0b-23d25409fd6e]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e7edf8-5418-4489-877d-e9f239796ea7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf911d15-eebf-4cf8-8eec-135ef88e113e]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbae2dd-975f-4536-bff0-caec83c5e45b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e352a9-a18b-43de-a130-883c92e79548]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260]
Nov 28 18:53:05 user nova-compute[75203]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558, portal: 172.16.0.220,3260] successful.
Nov 28 18:53:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e1bac3f-e5b9-481e-88ff-03c1b2847558 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99f14cb-0f5e-4032-8995-33b771bee18c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== disconnect_volume: return (327ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:53:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:53:06 user nova-compute[75203]: DEBUG nova.objects.instance [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid b61c9405-587d-4b45-9641-7b1e2d73475a {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-e40fd021-fce0-465b-a817-0b5655e55a23 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.767s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:53:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:53:09 user nova-compute[75203]: INFO nova.compute.claims [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Claim successful on node user
Nov 28 18:53:09 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:53:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:53:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.policy [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe8c1bccaa174d4da0865d55770703a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc3f94308cd4b99871d9113d6516bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:53:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Creating image(s)
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "/opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "/opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "/opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk 1073741824" returned: 0 in 0.054s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Successfully created port: 8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.228s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:53:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Cannot resize image /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Ensure instance console log exists: /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Successfully updated port: 8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquired lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-changed-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Refreshing instance network info cache due to event network-changed-8a2aa4e0-83a7-4020-b31e-f57b1a32a057. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] Acquiring lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Updating instance_info_cache with network_info: [{"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Releasing lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Instance network_info: |[{"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] Acquired lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.network.neutron [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Refreshing network info cache for port 8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Start _get_guest_xml network_info=[{"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:53:11 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:11 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:53:11 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-960323793',display_name='tempest-VolumesSnapshotTestJSON-instance-960323793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-960323793',id=33,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO089nCD++IF8sGfc893wlcDPk/K/Lbi0kjUkiyk+eYj63yllfpsDPTO07G2mSAbRWImrn44jG8+Upo3CYI8JUAAGWcWapbw4EYiwXQIqakhYTbJsvsRgTcGoY9jRmNlg==',key_name='tempest-keypair-2045904166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dc3f94308cd4b99871d9113d6516bfc',ramdisk_id='',reservation_id='r-a22xwyyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-926769811',owner_user_name='tempest-VolumesSnapshotTestJSON-926769811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:53:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8c1bccaa174d4da0865d55770703a2',uuid=48b0d74c-5f15-4a92-bc25-20f89c6d56c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converting VIF {"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=8a2aa4e0-83a7-4020-b31e-f57b1a32a057,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2aa4e0-83') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'pci_devices' on Instance uuid 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:53:12 user nova-compute[75203]:   <uuid>48b0d74c-5f15-4a92-bc25-20f89c6d56c7</uuid>
Nov 28 18:53:12 user nova-compute[75203]:   <name>instance-00000021</name>
Nov 28 18:53:12 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:53:12 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:53:12 user nova-compute[75203]:   <metadata>
Nov 28 18:53:12 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:53:12 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:53:12 user nova-compute[75203]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-960323793</nova:name>
Nov 28 18:53:12 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:53:11</nova:creationTime>
Nov 28 18:53:12 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:53:12 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:53:12 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:53:12 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:53:12 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:53:12 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:53:12 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:53:12 user nova-compute[75203]:       <nova:owner>
Nov 28 18:53:12 user nova-compute[75203]:         <nova:user uuid="fe8c1bccaa174d4da0865d55770703a2">tempest-VolumesSnapshotTestJSON-926769811-project-member</nova:user>
Nov 28 18:53:12 user nova-compute[75203]:         <nova:project uuid="8dc3f94308cd4b99871d9113d6516bfc">tempest-VolumesSnapshotTestJSON-926769811</nova:project>
Nov 28 18:53:12 user nova-compute[75203]:       </nova:owner>
Nov 28 18:53:12 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:53:12 user nova-compute[75203]:       <nova:ports>
Nov 28 18:53:12 user nova-compute[75203]:         <nova:port uuid="8a2aa4e0-83a7-4020-b31e-f57b1a32a057">
Nov 28 18:53:12 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 18:53:12 user nova-compute[75203]:         </nova:port>
Nov 28 18:53:12 user nova-compute[75203]:       </nova:ports>
Nov 28 18:53:12 user nova-compute[75203]:     </nova:instance>
Nov 28 18:53:12 user nova-compute[75203]:   </metadata>
Nov 28 18:53:12 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:53:12 user nova-compute[75203]:     <system>
Nov 28 18:53:12 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:53:12 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:53:12 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:53:12 user nova-compute[75203]:       <entry name="serial">48b0d74c-5f15-4a92-bc25-20f89c6d56c7</entry>
Nov 28 18:53:12 user nova-compute[75203]:       <entry name="uuid">48b0d74c-5f15-4a92-bc25-20f89c6d56c7</entry>
Nov 28 18:53:12 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:53:12 user nova-compute[75203]:     </system>
Nov 28 18:53:12 user nova-compute[75203]:   </sysinfo>
Nov 28 18:53:12 user nova-compute[75203]:   <os>
Nov 28 18:53:12 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:53:12 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:53:12 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:53:12 user nova-compute[75203]:   </os>
Nov 28 18:53:12 user nova-compute[75203]:   <features>
Nov 28 18:53:12 user nova-compute[75203]:     <acpi/>
Nov 28 18:53:12 user nova-compute[75203]:     <apic/>
Nov 28 18:53:12 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:53:12 user nova-compute[75203]:   </features>
Nov 28 18:53:12 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:53:12 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:53:12 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:53:12 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:53:12 user nova-compute[75203]:   </clock>
Nov 28 18:53:12 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:53:12 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:53:12 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:53:12 user nova-compute[75203]:   </cpu>
Nov 28 18:53:12 user nova-compute[75203]:   <devices>
Nov 28 18:53:12 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:53:12 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:53:12 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk"/>
Nov 28 18:53:12 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:53:12 user nova-compute[75203]:     </disk>
Nov 28 18:53:12 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:53:12 user nova-compute[75203]:       <mac address="fa:16:3e:02:55:7a"/>
Nov 28 18:53:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:53:12 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:53:12 user nova-compute[75203]:       <target dev="tap8a2aa4e0-83"/>
Nov 28 18:53:12 user nova-compute[75203]:     </interface>
Nov 28 18:53:12 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:53:12 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/console.log" append="off"/>
Nov 28 18:53:12 user nova-compute[75203]:     </serial>
Nov 28 18:53:12 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:53:12 user nova-compute[75203]:     <video>
Nov 28 18:53:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:53:12 user nova-compute[75203]:     </video>
Nov 28 18:53:12 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:53:12 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:53:12 user nova-compute[75203]:     </rng>
Nov 28 18:53:12 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:53:12 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:53:12 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:53:12 user nova-compute[75203]:     </memballoon>
Nov 28 18:53:12 user nova-compute[75203]:   </devices>
Nov 28 18:53:12 user nova-compute[75203]: </domain>
Nov 28 18:53:12 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-960323793',display_name='tempest-VolumesSnapshotTestJSON-instance-960323793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-960323793',id=33,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO089nCD++IF8sGfc893wlcDPk/K/Lbi0kjUkiyk+eYj63yllfpsDPTO07G2mSAbRWImrn44jG8+Upo3CYI8JUAAGWcWapbw4EYiwXQIqakhYTbJsvsRgTcGoY9jRmNlg==',key_name='tempest-keypair-2045904166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dc3f94308cd4b99871d9113d6516bfc',ramdisk_id='',reservation_id='r-a22xwyyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-926769811',owner_user_name='tempest-VolumesSnapshotTestJSON-926769811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:53:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8c1bccaa174d4da0865d55770703a2',uuid=48b0d74c-5f15-4a92-bc25-20f89c6d56c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converting VIF {"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=8a2aa4e0-83a7-4020-b31e-f57b1a32a057,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2aa4e0-83') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG os_vif [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=8a2aa4e0-83a7-4020-b31e-f57b1a32a057,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2aa4e0-83') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a085c89e-01cb-54e9-99c8-efcbbab7f23e', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a2aa4e0-83, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a2aa4e0-83, col_values=(('qos', UUID('f470c9c8-883e-401a-ad95-cfcd5880af29')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a2aa4e0-83, col_values=(('external_ids', {'iface-id': '8a2aa4e0-83a7-4020-b31e-f57b1a32a057', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:55:7a', 'vm-uuid': '48b0d74c-5f15-4a92-bc25-20f89c6d56c7'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:12 user nova-compute[75203]: INFO os_vif [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=8a2aa4e0-83a7-4020-b31e-f57b1a32a057,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2aa4e0-83')
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No VIF found with MAC fa:16:3e:02:55:7a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Updated VIF entry in instance network info cache for port 8a2aa4e0-83a7-4020-b31e-f57b1a32a057. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Updating instance_info_cache with network_info: [{"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f43c8617-d1b8-40b7-bb29-c55dd25e58cc req-db050237-c60a-48c5-8ebf-dc5afc72929d service nova] Releasing lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-7c063a6c-4b3a-49e6-a6ce-e6498ffd4952 req-a59f5c57-aea9-4ab8-8db1-d701d40df522 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7c063a6c-4b3a-49e6-a6ce-e6498ffd4952 req-a59f5c57-aea9-4ab8-8db1-d701d40df522 service nova] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7c063a6c-4b3a-49e6-a6ce-e6498ffd4952 req-a59f5c57-aea9-4ab8-8db1-d701d40df522 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7c063a6c-4b3a-49e6-a6ce-e6498ffd4952 req-a59f5c57-aea9-4ab8-8db1-d701d40df522 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-7c063a6c-4b3a-49e6-a6ce-e6498ffd4952 req-a59f5c57-aea9-4ab8-8db1-d701d40df522 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] No waiting events found dispatching network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:13 user nova-compute[75203]: WARNING nova.compute.manager [req-7c063a6c-4b3a-49e6-a6ce-e6498ffd4952 req-a59f5c57-aea9-4ab8-8db1-d701d40df522 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received unexpected event network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 for instance with vm_state building and task_state spawning.
Nov 28 18:53:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-81ec6ac7-85af-44dc-a92a-4bd6e1f93199 req-50c6f41d-4110-4d6d-ae0a-5eae60d25c18 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-81ec6ac7-85af-44dc-a92a-4bd6e1f93199 req-50c6f41d-4110-4d6d-ae0a-5eae60d25c18 service nova] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-81ec6ac7-85af-44dc-a92a-4bd6e1f93199 req-50c6f41d-4110-4d6d-ae0a-5eae60d25c18 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-81ec6ac7-85af-44dc-a92a-4bd6e1f93199 req-50c6f41d-4110-4d6d-ae0a-5eae60d25c18 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-81ec6ac7-85af-44dc-a92a-4bd6e1f93199 req-50c6f41d-4110-4d6d-ae0a-5eae60d25c18 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] No waiting events found dispatching network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:15 user nova-compute[75203]: WARNING nova.compute.manager [req-81ec6ac7-85af-44dc-a92a-4bd6e1f93199 req-50c6f41d-4110-4d6d-ae0a-5eae60d25c18 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received unexpected event network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 for instance with vm_state building and task_state spawning.
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:53:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Instance spawned successfully.
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:16 user nova-compute[75203]: INFO nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 28 18:53:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:53:16 user nova-compute[75203]: INFO nova.compute.manager [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Took 6.45 seconds to build instance.
Nov 28 18:53:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8d1e6ba1-5594-40a0-b35e-ef3930b00c54 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.684s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 18:53:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:53:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:53:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:30 user nova-compute[75203]: DEBUG nova.objects.instance [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'flavor' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:31 user nova-compute[75203]: INFO nova.compute.manager [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Attaching volume a6959b76-fc71-47ba-a86a-c918403d0f1b to /dev/vdb
Nov 28 18:53:31 user nova-compute[75203]: DEBUG os_brick.utils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04f6a4-22bc-4cd8-9afa-0bd41cab0665]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0d9f3f-e053-424c-8380-aa7889eaf5ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[237be39e-4d54-481e-8869-923521fc85c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9b6309-78b3-45ee-98b2-0d54e2d93367]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:53:31 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[024480aa-03ea-4826-8570-e4e3f24b7dd0]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG os_brick.utils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating existing volume attachment record: a36326b1-f136-46ce-981a-0c76416c115c {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:53:32 user nova-compute[75203]: INFO nova.compute.claims [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Claim successful on node user
Nov 28 18:53:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.network.neutron [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:53:32 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:53:32 user nova-compute[75203]: INFO nova.virt.block_device [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Booting with volume-backed-image 6c841bc3-8129-43e8-9397-445eaf245bad at /dev/vda
Nov 28 18:53:32 user nova-compute[75203]: DEBUG nova.policy [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad9a9772df954da0b42b5b102440c1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec1aaec341d441fb4da4fc53a985617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:53:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Successfully created port: 7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Successfully updated port: 7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-changed-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.compute.manager [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Refreshing instance network info cache due to event network-changed-7ce60268-403d-4ac8-ac63-c01d13e9e3f5. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] Acquiring lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating instance_info_cache with network_info: [{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance network_info: |[{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] Acquired lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:53:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Refreshing network info cache for port 7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:35 user nova-compute[75203]: INFO nova.compute.manager [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Terminating instance
Nov 28 18:53:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updated VIF entry in instance network info cache for port 7ce60268-403d-4ac8-ac63-c01d13e9e3f5. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG nova.network.neutron [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating instance_info_cache with network_info: [{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-34ae92ad-882c-4752-b8fa-63c8bd9e220c req-9bbc0f17-5385-4e7d-a1f8-6bb77c88efde service nova] Releasing lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:53:35 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Instance destroyed successfully.
Nov 28 18:53:35 user nova-compute[75203]: DEBUG nova.objects.instance [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'resources' on Instance uuid b61c9405-587d-4b45-9641-7b1e2d73475a {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:47:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1379046637',display_name='tempest-AttachVolumeNegativeTest-server-1379046637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1379046637',id=26,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPQWAVICBA1cBKJAJgv1HWrQ6RMOJFxDySF+mXEd/jjsKsJpPnV/qlgrJN+vgW06wpfhnV5V7tRjGsDony3d2PuwX5eUlXWYn3fxqVQbggB2rCPA6r/EUUa5Xx/rnu2dQ==',key_name='tempest-keypair-76007509',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:47:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-6p0kf4mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:47:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=b61c9405-587d-4b45-9641-7b1e2d73475a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "8c469b22-5936-4e14-b8db-1eb192478239", "address": "fa:16:3e:d9:08:3a", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c469b22-59", "ovs_interfaceid": "8c469b22-5936-4e14-b8db-1eb192478239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:08:3a,bridge_name='br-int',has_traffic_filtering=True,id=8c469b22-5936-4e14-b8db-1eb192478239,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c469b22-59') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG os_vif [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:08:3a,bridge_name='br-int',has_traffic_filtering=True,id=8c469b22-5936-4e14-b8db-1eb192478239,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c469b22-59') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c469b22-59, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c6b4d0d-7199-4cf7-8ca3-3a5bd03d372c) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:35 user nova-compute[75203]: INFO os_vif [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:08:3a,bridge_name='br-int',has_traffic_filtering=True,id=8c469b22-5936-4e14-b8db-1eb192478239,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c469b22-59')
Nov 28 18:53:35 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Deleting instance files /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a_del
Nov 28 18:53:35 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Deletion of /opt/stack/data/nova/instances/b61c9405-587d-4b45-9641-7b1e2d73475a_del complete
Nov 28 18:53:36 user nova-compute[75203]: INFO nova.compute.manager [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-vif-unplugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] No waiting events found dispatching network-vif-unplugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-vif-unplugged-8c469b22-5936-4e14-b8db-1eb192478239 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] Acquiring lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.compute.manager [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] No waiting events found dispatching network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:36 user nova-compute[75203]: WARNING nova.compute.manager [req-6bb082bd-fca9-4d72-ad89-13772896a21b req-328ce7aa-3b72-4fbd-ae31-ee1d5a79072d service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received unexpected event network-vif-plugged-8c469b22-5936-4e14-b8db-1eb192478239 for instance with vm_state active and task_state deleting.
Nov 28 18:53:36 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:36 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Took 0.80 seconds to deallocate network for instance.
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:37 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:53:37 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:53:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:37 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Deleted allocations for instance b61c9405-587d-4b45-9641-7b1e2d73475a
Nov 28 18:53:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8385a8ec-c27c-470c-a7c2-26c0aa738b52 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "b61c9405-587d-4b45-9641-7b1e2d73475a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-472a361f-349f-429c-bfbb-18f3b754a9ca req-01684423-5f02-4537-9d65-7e09556ca7aa service nova] [instance: b61c9405-587d-4b45-9641-7b1e2d73475a] Received event network-vif-deleted-8c469b22-5936-4e14-b8db-1eb192478239 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhgVocbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:53:42 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:53:42 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:53:42 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed04f189-877d-4978-bb76-d509a02abc8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:53:42 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e3f8e6-6da8-4071-87cb-1251cc122b3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b] added
Nov 28 18:53:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad641ee-09ec-4b8e-a241-4c9ecec1f159]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[99404c19-18fe-443a-8410-29b4b0880ac0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YhgVocbe {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YhgVocbe" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c6e0db-78d3-4e7f-a576-446456bb67f8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YhgVocbe'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aa4aac-de20-44bf-87c7-86ff30d756e0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7bcea4-6551-4487-bf89-ec4f661fa5bd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e091b4c3-0f76-42fc-be3f-4ca67636b8ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260]
Nov 28 18:53:42 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260] successful.
Nov 28 18:53:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b319ddc-5363-437f-80b3-df47591d6474]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68fc7f3-c7e2-4a0c-9eb1-9c3a31787504]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:42 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:42 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f5f24-1780-4012-a0b7-53dc00d6efb8]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:53:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhgVocbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.utils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bf9ba1-6d88-466c-8aad-283d504050b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae73c04-1f98-4dcb-a2bc-f1296024cb69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c8e530-a691-4f7d-81e2-aaf7ea250349]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a215944-317e-4c25-b635-e0af1dfb8786]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:53:43 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:53:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e356379-3236-4e31-90c9-8b283b32896d]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.utils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating existing volume attachment record: fc1aef18-75cd-4277-ab75-10d90ecb9332 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26435613135643062', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435613135643062', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'flavor' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:53:43 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:53:43 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:53:43 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:53:43 user nova-compute[75203]:   <serial>a6959b76-fc71-47ba-a86a-c918403d0f1b</serial>
Nov 28 18:53:43 user nova-compute[75203]: </disk>
Nov 28 18:53:43 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:53:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:53:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:53:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No VIF found with MAC fa:16:3e:af:ed:f9, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:53:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0677595e-0c47-4931-8086-a56dabfc6c56 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.228s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:45 user nova-compute[75203]: INFO nova.compute.manager [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Rescuing
Nov 28 18:53:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:53:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:53:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:53:45 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:53:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-8d503fdd-8d27-4589-820e-31fb45fc367d req-218484bd-27b8-4c40-8291-24bd14bc951b service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8d503fdd-8d27-4589-820e-31fb45fc367d req-218484bd-27b8-4c40-8291-24bd14bc951b service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8d503fdd-8d27-4589-820e-31fb45fc367d req-218484bd-27b8-4c40-8291-24bd14bc951b service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8d503fdd-8d27-4589-820e-31fb45fc367d req-218484bd-27b8-4c40-8291-24bd14bc951b service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-8d503fdd-8d27-4589-820e-31fb45fc367d req-218484bd-27b8-4c40-8291-24bd14bc951b service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:46 user nova-compute[75203]: WARNING nova.compute.manager [req-8d503fdd-8d27-4589-820e-31fb45fc367d req-218484bd-27b8-4c40-8291-24bd14bc951b service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state active and task_state rescuing.
Nov 28 18:53:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance destroyed successfully.
Nov 28 18:53:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Attempting a stable device rescue
Nov 28 18:53:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75203) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:53:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Creating image(s)
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "b8ebbec09c0566859c39fb4b125a0aa499e5f7eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "b8ebbec09c0566859c39fb4b125a0aa499e5f7eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG nova.virt.images [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] e48c8667-b577-4732-8e6d-32219d8b29f3 was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.part /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-79c945b0-38cd-4f37-8859-a7a3b73190fc req-968f7534-ccd1-4c6b-9195-18c4e6a0710c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-79c945b0-38cd-4f37-8859-a7a3b73190fc req-968f7534-ccd1-4c6b-9195-18c4e6a0710c service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-79c945b0-38cd-4f37-8859-a7a3b73190fc req-968f7534-ccd1-4c6b-9195-18c4e6a0710c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-79c945b0-38cd-4f37-8859-a7a3b73190fc req-968f7534-ccd1-4c6b-9195-18c4e6a0710c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-79c945b0-38cd-4f37-8859-a7a3b73190fc req-968f7534-ccd1-4c6b-9195-18c4e6a0710c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:48 user nova-compute[75203]: WARNING nova.compute.manager [req-79c945b0-38cd-4f37-8859-a7a3b73190fc req-968f7534-ccd1-4c6b-9195-18c4e6a0710c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state active and task_state rescuing.
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:48 user nova-compute[75203]: INFO nova.compute.manager [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Terminating instance
Nov 28 18:53:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.part /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.converted" returned: 0 in 0.708s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "b8ebbec09c0566859c39fb4b125a0aa499e5f7eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.216s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "b8ebbec09c0566859c39fb4b125a0aa499e5f7eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "b8ebbec09c0566859c39fb4b125a0aa499e5f7eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Instance destroyed successfully.
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lazy-loading 'resources' on Instance uuid 4382dd69-a9f8-45a8-ae99-78d295cb606f {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb,backing_fmt=raw /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:34:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1729216457',display_name='tempest-ServerActionsTestOtherA-server-1729216457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1729216457',id=5,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8IAKTUACjFG6bQIXRCeZsm0UYl3ktfRImtPAxIvz180rwkkxEEETxfSRdXiHHpc3hUl1yjhGzgyEB9pXPEmC9fciRKDr/PvvKDzYDGpd1phGsvchMZlv71LrW6AHJFtA==',key_name='tempest-keypair-2075176053',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='974923cb2e06473bbd8e4122888494df',ramdisk_id='',reservation_id='r-qvi68p7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1893596751',owner_user_name='tempest-ServerActionsTestOtherA-1893596751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:35:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b7ea4623ff14b2ea244c31ac84dd600',uuid=4382dd69-a9f8-45a8-ae99-78d295cb606f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converting VIF {"id": "697e8d57-71b4-41ea-87e0-507601444786", "address": "fa:16:3e:69:e4:8d", "network": {"id": "d4c52522-bcc0-4741-a97d-51b820b32900", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-85259579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "974923cb2e06473bbd8e4122888494df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap697e8d57-71", "ovs_interfaceid": "697e8d57-71b4-41ea-87e0-507601444786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=697e8d57-71b4-41ea-87e0-507601444786,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697e8d57-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_vif [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=697e8d57-71b4-41ea-87e0-507601444786,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697e8d57-71') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb,backing_fmt=raw /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue" returned: 0 in 0.063s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap697e8d57-71, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "b8ebbec09c0566859c39fb4b125a0aa499e5f7eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'migration_context' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e22854d-665e-425d-9a57-a51db74ee3ce) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Object Instance<2dcad16f-a0dd-4d8d-829e-16e9e6093cf4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Start _get_guest_xml network_info=[{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "vif_mac": "fa:16:3e:af:ed:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e48c8667-b577-4732-8e6d-32219d8b29f3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhgVocbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2dcad16f-a0dd-4d8d-829e-16e9e6093cf4', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6959b76-fc71-47ba-a86a-c918403d0f1b', 'serial': 'a6959b76-fc71-47ba-a86a-c918403d0f1b'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'a36326b1-f136-46ce-981a-0c76416c115c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'resources' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:49 user nova-compute[75203]: INFO os_vif [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=697e8d57-71b4-41ea-87e0-507601444786,network=Network(d4c52522-bcc0-4741-a97d-51b820b32900),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap697e8d57-71')
Nov 28 18:53:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Deleting instance files /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f_del
Nov 28 18:53:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Deletion of /opt/stack/data/nova/instances/4382dd69-a9f8-45a8-ae99-78d295cb606f_del complete
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Object Instance<2dcad16f-a0dd-4d8d-829e-16e9e6093cf4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'numa_topology' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Object Instance<2dcad16f-a0dd-4d8d-829e-16e9e6093cf4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:53:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Object Instance<2dcad16f-a0dd-4d8d-829e-16e9e6093cf4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhgVocbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:53:49 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:53:49 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:53:49 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:53:49 user nova-compute[75203]: INFO nova.compute.manager [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f502d34-7e48-4d96-8d0a-47f4c983ea20]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YhgVocbe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 18:53:49 user nova-compute[75203]: node.name = iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b
Nov 28 18:53:49 user nova-compute[75203]: node.tpgt = -1
Nov 28 18:53:49 user nova-compute[75203]: node.startup = automatic
Nov 28 18:53:49 user nova-compute[75203]: node.leading_login = No
Nov 28 18:53:49 user nova-compute[75203]: iface.iscsi_ifacename = default
Nov 28 18:53:49 user nova-compute[75203]: iface.net_ifacename = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.ipaddress = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.prefix_len = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.hwaddress = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.transport_name = tcp
Nov 28 18:53:49 user nova-compute[75203]: iface.initiatorname = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.state = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.vlan_id = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.vlan_priority = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.vlan_state = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.iface_num = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.mtu = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.port = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.bootproto = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.subnet_mask = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.gateway = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_alt_client_id = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_dns = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_learn_iqn = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_vendor_id_state = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_vendor_id = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.dhcp_slp_da = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.fragmentation = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.gratuitous_arp = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.incoming_forwarding = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.tos_state = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.tos = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.ttl = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.delayed_ack = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.tcp_nagle = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.tcp_wsf_state = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.tcp_wsf = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.tcp_timer_scale = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.tcp_timestamp = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.redirect = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.def_task_mgmt_timeout = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.header_digest = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.data_digest = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.immediate_data = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.initial_r2t = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.data_seq_inorder = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.data_pdu_inorder = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.erl = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.max_receive_data_len = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.first_burst_len = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.max_outstanding_r2t = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.max_burst_len = 0
Nov 28 18:53:49 user nova-compute[75203]: iface.chap_auth = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.bidi_chap = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.strict_login_compliance = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.discovery_auth = <empty>
Nov 28 18:53:49 user nova-compute[75203]: iface.discovery_logout = <empty>
Nov 28 18:53:49 user nova-compute[75203]: node.discovery_address = <empty>
Nov 28 18:53:49 user nova-compute[75203]: node.discovery_port = 0
Nov 28 18:53:49 user nova-compute[75203]: node.discovery_type = static
Nov 28 18:53:49 user nova-compute[75203]: node.session.initial_cmdsn = 0
Nov 28 18:53:49 user nova-compute[75203]: node.session.initial_login_retry_max = 8
Nov 28 18:53:49 user nova-compute[75203]: node.session.xmit_thread_priority = -20
Nov 28 18:53:49 user nova-compute[75203]: node.session.cmds_max = 128
Nov 28 18:53:49 user nova-compute[75203]: node.session.queue_depth = 32
Nov 28 18:53:49 user nova-compute[75203]: node.session.nr_sessions = 1
Nov 28 18:53:49 user nova-compute[75203]: node.session.auth.authmethod = CHAP
Nov 28 18:53:49 user nova-compute[75203]: node.session.auth.username = YhgVocbe
Nov 28 18:53:49 user nova-compute[75203]: node.session.auth.password = ***
Nov 28 18:53:49 user nova-compute[75203]: node.session.auth.username_in = <empty>
Nov 28 18:53:49 user nova-compute[75203]: node.session.auth.password_in = <empty>
Nov 28 18:53:49 user nova-compute[75203]: node.session.auth.chap_algs = MD5
Nov 28 18:53:49 user nova-compute[75203]: node.session.timeo.replacement_timeout = 120
Nov 28 18:53:49 user nova-compute[75203]: node.session.err_timeo.abort_timeout = 15
Nov 28 18:53:49 user nova-compute[75203]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 18:53:49 user nova-compute[75203]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 18:53:49 user nova-compute[75203]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.FastAbort = Yes
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.InitialR2T = No
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.ImmediateData = Yes
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.MaxConnections = 1
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 18:53:49 user nova-compute[75203]: node.session.iscsi.ERL = 0
Nov 28 18:53:49 user nova-compute[75203]: node.session.scan = manual
Nov 28 18:53:49 user nova-compute[75203]: node.session.reopen_max = 0
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].address = 172.16.0.220
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].port = 3260
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].startup = manual
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].tcp.window_size = 524288
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].tcp.type_of_service = 0
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].timeo.logout_timeout = 15
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].timeo.login_timeout = 15
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].timeo.auth_timeout = 45
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].iscsi.DataDigest = None
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].iscsi.IFMarker = No
Nov 28 18:53:49 user nova-compute[75203]: node.conn[0].iscsi.OFMarker = No
Nov 28 18:53:49 user nova-compute[75203]: # END RECORD
Nov 28 18:53:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba68d6e-3cf3-44ea-8326-8e51f056fdfc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b345aef-024e-4da8-aef7-d4d79d2b4248]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YhgVocbe {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YhgVocbe" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d47ff-90c0-411d-ae89-1ef9feef4020]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YhgVocbe'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3f7ec2-52a1-4a61-b83e-92d4d98ea2b5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9e64c3-59aa-45c7-a9b5-e2a6129d8bb3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:49 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:49 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] HCTL ('33', '0', '0', 0) found on session 34 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[606013d4-e4f9-4377-8bc6-23b36e700d7a]: (4, ('0 0 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Searching for a device in session 34 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhgVocbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] <== connect_volume: return (202ms) {'type': 'block', 'scsi_wwn': '26435613135643062', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435613135643062', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-216485763',display_name='tempest-ServerStableDeviceRescueTest-server-216485763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-216485763',id=29,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjBUTde2IUZlcPjPkqpXPTcC7hMwTKmf94yvJIrIK8uKKAS2lss5668VzKj/wB72dIaaLGe8rlmmbo8x90E2y6UipdIw8Ly7yjNOtIju+jcy0xA9ygkZvM3Y+jWjHIidQ==',key_name='tempest-keypair-696441057',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e9091039cac4e20b440f4852ad7f293',ramdisk_id='',reservation_id='r-oojliyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1663211552',owner_user_name='tempest-ServerStableDeviceRescueTest-1663211552-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='caa3702219cd4ca48fd9754cf1037f24',uuid=2dcad16f-a0dd-4d8d-829e-16e9e6093cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "vif_mac": "fa:16:3e:af:ed:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converting VIF {"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "vif_mac": "fa:16:3e:af:ed:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.objects.base [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Object Instance<2dcad16f-a0dd-4d8d-829e-16e9e6093cf4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:53:49 user nova-compute[75203]:   <uuid>2dcad16f-a0dd-4d8d-829e-16e9e6093cf4</uuid>
Nov 28 18:53:49 user nova-compute[75203]:   <name>instance-0000001d</name>
Nov 28 18:53:49 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:53:49 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:53:49 user nova-compute[75203]:   <metadata>
Nov 28 18:53:49 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:53:49 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:53:49 user nova-compute[75203]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-216485763</nova:name>
Nov 28 18:53:49 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:53:49</nova:creationTime>
Nov 28 18:53:49 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:53:49 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:53:49 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:53:49 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:53:49 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:53:49 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:53:49 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:53:49 user nova-compute[75203]:       <nova:owner>
Nov 28 18:53:49 user nova-compute[75203]:         <nova:user uuid="caa3702219cd4ca48fd9754cf1037f24">tempest-ServerStableDeviceRescueTest-1663211552-project-member</nova:user>
Nov 28 18:53:49 user nova-compute[75203]:         <nova:project uuid="0e9091039cac4e20b440f4852ad7f293">tempest-ServerStableDeviceRescueTest-1663211552</nova:project>
Nov 28 18:53:49 user nova-compute[75203]:       </nova:owner>
Nov 28 18:53:49 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:53:49 user nova-compute[75203]:       <nova:ports>
Nov 28 18:53:49 user nova-compute[75203]:         <nova:port uuid="b48b28f4-803d-4ec6-9acd-53b1f4c11568">
Nov 28 18:53:49 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 18:53:49 user nova-compute[75203]:         </nova:port>
Nov 28 18:53:49 user nova-compute[75203]:       </nova:ports>
Nov 28 18:53:49 user nova-compute[75203]:     </nova:instance>
Nov 28 18:53:49 user nova-compute[75203]:   </metadata>
Nov 28 18:53:49 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:53:49 user nova-compute[75203]:     <system>
Nov 28 18:53:49 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:53:49 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:53:49 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:53:49 user nova-compute[75203]:       <entry name="serial">2dcad16f-a0dd-4d8d-829e-16e9e6093cf4</entry>
Nov 28 18:53:49 user nova-compute[75203]:       <entry name="uuid">2dcad16f-a0dd-4d8d-829e-16e9e6093cf4</entry>
Nov 28 18:53:49 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:53:49 user nova-compute[75203]:     </system>
Nov 28 18:53:49 user nova-compute[75203]:   </sysinfo>
Nov 28 18:53:49 user nova-compute[75203]:   <os>
Nov 28 18:53:49 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:53:49 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:53:49 user nova-compute[75203]:   </os>
Nov 28 18:53:49 user nova-compute[75203]:   <features>
Nov 28 18:53:49 user nova-compute[75203]:     <acpi/>
Nov 28 18:53:49 user nova-compute[75203]:     <apic/>
Nov 28 18:53:49 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:53:49 user nova-compute[75203]:   </features>
Nov 28 18:53:49 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:53:49 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:53:49 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:53:49 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:53:49 user nova-compute[75203]:   </clock>
Nov 28 18:53:49 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:53:49 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:53:49 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:53:49 user nova-compute[75203]:   </cpu>
Nov 28 18:53:49 user nova-compute[75203]:   <devices>
Nov 28 18:53:49 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:53:49 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:53:49 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk"/>
Nov 28 18:53:49 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:53:49 user nova-compute[75203]:     </disk>
Nov 28 18:53:49 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:53:49 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:53:49 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 18:53:49 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:53:49 user nova-compute[75203]:       <serial>a6959b76-fc71-47ba-a86a-c918403d0f1b</serial>
Nov 28 18:53:49 user nova-compute[75203]:     </disk>
Nov 28 18:53:49 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:53:49 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:53:49 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue"/>
Nov 28 18:53:49 user nova-compute[75203]:       <target dev="vdc" bus="virtio"/>
Nov 28 18:53:49 user nova-compute[75203]:       <boot order="1"/>
Nov 28 18:53:49 user nova-compute[75203]:     </disk>
Nov 28 18:53:49 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:53:49 user nova-compute[75203]:       <mac address="fa:16:3e:af:ed:f9"/>
Nov 28 18:53:49 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:53:49 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:53:49 user nova-compute[75203]:       <target dev="tapb48b28f4-80"/>
Nov 28 18:53:49 user nova-compute[75203]:     </interface>
Nov 28 18:53:49 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:53:49 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/console.log" append="off"/>
Nov 28 18:53:49 user nova-compute[75203]:     </serial>
Nov 28 18:53:49 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:53:49 user nova-compute[75203]:     <video>
Nov 28 18:53:49 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:53:49 user nova-compute[75203]:     </video>
Nov 28 18:53:49 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:53:49 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:53:49 user nova-compute[75203]:     </rng>
Nov 28 18:53:49 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:53:49 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:53:49 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:53:49 user nova-compute[75203]:     </memballoon>
Nov 28 18:53:49 user nova-compute[75203]:   </devices>
Nov 28 18:53:49 user nova-compute[75203]: </domain>
Nov 28 18:53:49 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:53:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance destroyed successfully.
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:53:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] No VIF found with MAC fa:16:3e:af:ed:f9, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:50 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Took 0.51 seconds to deallocate network for instance.
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-vif-unplugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] No waiting events found dispatching network-vif-unplugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:50 user nova-compute[75203]: WARNING nova.compute.manager [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received unexpected event network-vif-unplugged-697e8d57-71b4-41ea-87e0-507601444786 for instance with vm_state deleted and task_state None.
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] Acquiring lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] No waiting events found dispatching network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:50 user nova-compute[75203]: WARNING nova.compute.manager [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received unexpected event network-vif-plugged-697e8d57-71b4-41ea-87e0-507601444786 for instance with vm_state deleted and task_state None.
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-3bbdafea-ff89-46d2-91ee-df7742c01981 req-18a77e70-bcc7-4f96-a2a3-9d02fc07f156 service nova] [instance: 4382dd69-a9f8-45a8-ae99-78d295cb606f] Received event network-vif-deleted-697e8d57-71b4-41ea-87e0-507601444786 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:50 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Deleted allocations for instance 4382dd69-a9f8-45a8-ae99-78d295cb606f
Nov 28 18:53:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d8-f3b1-4711-a6b1-aef7f3b2f3f1 tempest-ServerActionsTestOtherA-1893596751 tempest-ServerActionsTestOtherA-1893596751-project-member] Lock "4382dd69-a9f8-45a8-ae99-78d295cb606f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:52 user nova-compute[75203]: WARNING nova.compute.manager [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state active and task_state rescuing.
Nov 28 18:53:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:52 user nova-compute[75203]: WARNING nova.compute.manager [req-749f1c88-ce32-44a6-a059-6eed03f60f85 req-75593147-3a82-4b66-a85b-70898151b5cb service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state active and task_state rescuing.
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b18ee90a-3c55-434c-ae4f-3eb71f9da7b6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:53:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Creating image(s)
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Ensure instance console log exists: /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Start _get_guest_xml network_info=[{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKGNabSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '43144e1b-45b4-4d5e-b81b-4246a96f3c1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a604db6c-1a43-4dc4-9c8a-8d922675c822', 'serial': 'a604db6c-1a43-4dc4-9c8a-8d922675c822'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'fc1aef18-75cd-4277-ab75-10d90ecb9332', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:53:53 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:53 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKGNabSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:53:53 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:53:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:53:53 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:53:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:53:53 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83553f-fd22-4108-809a-b487af3a966e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:53:53 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d04c0-f8ab-4135-bcbe-dc61316cb946]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822] added
Nov 28 18:53:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=24.866973876953125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4bf76e-2349-4731-a28d-72225ba7da09]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da1d7cf-f9e2-4d66-8f26-aeb03fd91b10]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKGNabSq {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKGNabSq" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[43176569-f0f3-459a-9083-1034dd7ce812]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKGNabSq'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[054909f9-7f96-442f-bf5e-10d6d4a09f29]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[680de8fc-18fc-4ceb-8a3d-fa952d52fddf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:54 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:54 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --login" returned: 0 in 0.233s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba89eac-94e7-48e0-be61-fc781bd774d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260]
Nov 28 18:53:54 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260] successful.
Nov 28 18:53:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.084s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b74d929-aced-4642-8947-1a379171aae1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3989945c-1b43-4222-be56-9f9957f36f76]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:54 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:54 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:53:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:53:54 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:53:54 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:53:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.905s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc5f2b-279a-45b1-be0e-783fab919245]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:53:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKGNabSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.936s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== connect_volume: return (1938ms) {'type': 'block', 'scsi_wwn': '26466303036313931', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466303036313931', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967500111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967500111',id=34,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-nx6ujcs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:53:33Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=43144e1b-45b4-4d5e-b81b-4246a96f3c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'pci_devices' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:53:55 user nova-compute[75203]:   <uuid>43144e1b-45b4-4d5e-b81b-4246a96f3c1d</uuid>
Nov 28 18:53:55 user nova-compute[75203]:   <name>instance-00000022</name>
Nov 28 18:53:55 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:53:55 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:53:55 user nova-compute[75203]:   <metadata>
Nov 28 18:53:55 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:53:55 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:53:55 user nova-compute[75203]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1967500111</nova:name>
Nov 28 18:53:55 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:53:53</nova:creationTime>
Nov 28 18:53:55 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:53:55 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:53:55 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:53:55 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:53:55 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:53:55 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:53:55 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:53:55 user nova-compute[75203]:       <nova:owner>
Nov 28 18:53:55 user nova-compute[75203]:         <nova:user uuid="ad9a9772df954da0b42b5b102440c1d0">tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member</nova:user>
Nov 28 18:53:55 user nova-compute[75203]:         <nova:project uuid="eec1aaec341d441fb4da4fc53a985617">tempest-ServerBootFromVolumeStableRescueTest-1173209255</nova:project>
Nov 28 18:53:55 user nova-compute[75203]:       </nova:owner>
Nov 28 18:53:55 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:53:55 user nova-compute[75203]:       <nova:ports>
Nov 28 18:53:55 user nova-compute[75203]:         <nova:port uuid="7ce60268-403d-4ac8-ac63-c01d13e9e3f5">
Nov 28 18:53:55 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 18:53:55 user nova-compute[75203]:         </nova:port>
Nov 28 18:53:55 user nova-compute[75203]:       </nova:ports>
Nov 28 18:53:55 user nova-compute[75203]:     </nova:instance>
Nov 28 18:53:55 user nova-compute[75203]:   </metadata>
Nov 28 18:53:55 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:53:55 user nova-compute[75203]:     <system>
Nov 28 18:53:55 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:53:55 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:53:55 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:53:55 user nova-compute[75203]:       <entry name="serial">43144e1b-45b4-4d5e-b81b-4246a96f3c1d</entry>
Nov 28 18:53:55 user nova-compute[75203]:       <entry name="uuid">43144e1b-45b4-4d5e-b81b-4246a96f3c1d</entry>
Nov 28 18:53:55 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:53:55 user nova-compute[75203]:     </system>
Nov 28 18:53:55 user nova-compute[75203]:   </sysinfo>
Nov 28 18:53:55 user nova-compute[75203]:   <os>
Nov 28 18:53:55 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:53:55 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:53:55 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:53:55 user nova-compute[75203]:   </os>
Nov 28 18:53:55 user nova-compute[75203]:   <features>
Nov 28 18:53:55 user nova-compute[75203]:     <acpi/>
Nov 28 18:53:55 user nova-compute[75203]:     <apic/>
Nov 28 18:53:55 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:53:55 user nova-compute[75203]:   </features>
Nov 28 18:53:55 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:53:55 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:53:55 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:53:55 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:53:55 user nova-compute[75203]:   </clock>
Nov 28 18:53:55 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:53:55 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:53:55 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:53:55 user nova-compute[75203]:   </cpu>
Nov 28 18:53:55 user nova-compute[75203]:   <devices>
Nov 28 18:53:55 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:53:55 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:53:55 user nova-compute[75203]:       <source dev="/dev/sdd"/>
Nov 28 18:53:55 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:53:55 user nova-compute[75203]:       <serial>a604db6c-1a43-4dc4-9c8a-8d922675c822</serial>
Nov 28 18:53:55 user nova-compute[75203]:     </disk>
Nov 28 18:53:55 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:53:55 user nova-compute[75203]:       <mac address="fa:16:3e:6e:25:e5"/>
Nov 28 18:53:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:53:55 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:53:55 user nova-compute[75203]:       <target dev="tap7ce60268-40"/>
Nov 28 18:53:55 user nova-compute[75203]:     </interface>
Nov 28 18:53:55 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:53:55 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/console.log" append="off"/>
Nov 28 18:53:55 user nova-compute[75203]:     </serial>
Nov 28 18:53:55 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:53:55 user nova-compute[75203]:     <video>
Nov 28 18:53:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:53:55 user nova-compute[75203]:     </video>
Nov 28 18:53:55 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:53:55 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:53:55 user nova-compute[75203]:     </rng>
Nov 28 18:53:55 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:53:55 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:53:55 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:53:55 user nova-compute[75203]:     </memballoon>
Nov 28 18:53:55 user nova-compute[75203]:   </devices>
Nov 28 18:53:55 user nova-compute[75203]: </domain>
Nov 28 18:53:55 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967500111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967500111',id=34,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-nx6ujcs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:53:33Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=43144e1b-45b4-4d5e-b81b-4246a96f3c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG os_vif [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '348ffe92-5fd2-559f-9fc9-852522cd549c', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ce60268-40, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ce60268-40, col_values=(('qos', UUID('cafb1849-44a6-4a53-a721-f1a40d77aa0c')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ce60268-40, col_values=(('external_ids', {'iface-id': '7ce60268-403d-4ac8-ac63-c01d13e9e3f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:25:e5', 'vm-uuid': '43144e1b-45b4-4d5e-b81b-4246a96f3c1d'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:55 user nova-compute[75203]: INFO os_vif [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40')
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No VIF found with MAC fa:16:3e:6e:25:e5, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:53:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-38d56838-d97f-4bd8-a690-3b3790dc930f req-c0abe6a7-5b0b-4fa4-bdfa-eec75f7b0d51 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-38d56838-d97f-4bd8-a690-3b3790dc930f req-c0abe6a7-5b0b-4fa4-bdfa-eec75f7b0d51 service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-38d56838-d97f-4bd8-a690-3b3790dc930f req-c0abe6a7-5b0b-4fa4-bdfa-eec75f7b0d51 service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-38d56838-d97f-4bd8-a690-3b3790dc930f req-c0abe6a7-5b0b-4fa4-bdfa-eec75f7b0d51 service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-38d56838-d97f-4bd8-a690-3b3790dc930f req-c0abe6a7-5b0b-4fa4-bdfa-eec75f7b0d51 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:57 user nova-compute[75203]: WARNING nova.compute.manager [req-38d56838-d97f-4bd8-a690-3b3790dc930f req-c0abe6a7-5b0b-4fa4-bdfa-eec75f7b0d51 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state building and task_state spawning.
Nov 28 18:53:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:53:57 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:53:58 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:53:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:53:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:53:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-2d2c8c66-f060-4c81-b18f-2f0a523bd17f req-b5eb9be0-ae48-4205-b4b9-a0c40350563c service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2d2c8c66-f060-4c81-b18f-2f0a523bd17f req-b5eb9be0-ae48-4205-b4b9-a0c40350563c service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2d2c8c66-f060-4c81-b18f-2f0a523bd17f req-b5eb9be0-ae48-4205-b4b9-a0c40350563c service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2d2c8c66-f060-4c81-b18f-2f0a523bd17f req-b5eb9be0-ae48-4205-b4b9-a0c40350563c service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.compute.manager [req-2d2c8c66-f060-4c81-b18f-2f0a523bd17f req-b5eb9be0-ae48-4205-b4b9-a0c40350563c service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:53:59 user nova-compute[75203]: WARNING nova.compute.manager [req-2d2c8c66-f060-4c81-b18f-2f0a523bd17f req-b5eb9be0-ae48-4205-b4b9-a0c40350563c service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state building and task_state spawning.
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:53:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance spawned successfully.
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:53:59 user nova-compute[75203]: INFO nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 28 18:53:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:53:59 user nova-compute[75203]: INFO nova.compute.manager [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Took 27.90 seconds to build instance.
Nov 28 18:53:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-029e15f7-353f-488b-935c-e37ba9fa874a tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.061s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:54:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:54:17 user nova-compute[75203]: INFO nova.compute.claims [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Claim successful on node user
Nov 28 18:54:17 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:54:18 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.policy [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f1489f9bd56496cac71675d6ae84be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f24bc0fa04465794db58c27a0d75f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:54:18 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Creating image(s)
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "/opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "/opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "/opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk 1073741824" returned: 0 in 0.108s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Successfully created port: 9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Cannot resize image /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Ensure instance console log exists: /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Successfully updated port: 9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquired lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.compute.manager [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received event network-changed-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.compute.manager [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Refreshing instance network info cache due to event network-changed-9b714a0d-a38e-48e8-a118-2c76760365ef. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] Acquiring lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Updating instance_info_cache with network_info: [{"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Releasing lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Instance network_info: |[{"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] Acquired lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.neutron [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Refreshing network info cache for port 9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Start _get_guest_xml network_info=[{"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:54:19 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:19 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1610387206',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1610387206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1610387',id=35,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOaodbGfF/RG4WNOUNPUgIvoh9Mma2YwUkrY0QxiXIXvTWgRcR+BaMgXAP7JoJ7T6WAE7jFnguG1Y304LYRC2YxKUJOtXk1/X4Bn3LGZbwEQ1smu0Q8GbVsdcR2FKHFFQ==',key_name='tempest-keypair-1535421511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63f24bc0fa04465794db58c27a0d75f3',ramdisk_id='',reservation_id='r-tvqo0gna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1380192923',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f1489f9bd56496cac71675d6ae84be5',uuid=25169f0a-a8e6-4a00-a373-06607a08d237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Converting VIF {"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:99:22,bridge_name='br-int',has_traffic_filtering=True,id=9b714a0d-a38e-48e8-a118-2c76760365ef,network=Network(1138145a-b915-42b9-af5f-d852f71b250e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b714a0d-a3') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lazy-loading 'pci_devices' on Instance uuid 25169f0a-a8e6-4a00-a373-06607a08d237 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:54:19 user nova-compute[75203]:   <uuid>25169f0a-a8e6-4a00-a373-06607a08d237</uuid>
Nov 28 18:54:19 user nova-compute[75203]:   <name>instance-00000023</name>
Nov 28 18:54:19 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:54:19 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:54:19 user nova-compute[75203]:   <metadata>
Nov 28 18:54:19 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:54:19 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:54:19 user nova-compute[75203]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1610387206</nova:name>
Nov 28 18:54:19 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:54:19</nova:creationTime>
Nov 28 18:54:19 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:54:19 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:54:19 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:54:19 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:54:19 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:54:19 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:54:19 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:54:19 user nova-compute[75203]:       <nova:owner>
Nov 28 18:54:19 user nova-compute[75203]:         <nova:user uuid="1f1489f9bd56496cac71675d6ae84be5">tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member</nova:user>
Nov 28 18:54:19 user nova-compute[75203]:         <nova:project uuid="63f24bc0fa04465794db58c27a0d75f3">tempest-TestServerVolumeAttachScenarioOldVersion-1380192923</nova:project>
Nov 28 18:54:19 user nova-compute[75203]:       </nova:owner>
Nov 28 18:54:19 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:54:19 user nova-compute[75203]:       <nova:ports>
Nov 28 18:54:19 user nova-compute[75203]:         <nova:port uuid="9b714a0d-a38e-48e8-a118-2c76760365ef">
Nov 28 18:54:19 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 18:54:19 user nova-compute[75203]:         </nova:port>
Nov 28 18:54:19 user nova-compute[75203]:       </nova:ports>
Nov 28 18:54:19 user nova-compute[75203]:     </nova:instance>
Nov 28 18:54:19 user nova-compute[75203]:   </metadata>
Nov 28 18:54:19 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:54:19 user nova-compute[75203]:     <system>
Nov 28 18:54:19 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:54:19 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:54:19 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:54:19 user nova-compute[75203]:       <entry name="serial">25169f0a-a8e6-4a00-a373-06607a08d237</entry>
Nov 28 18:54:19 user nova-compute[75203]:       <entry name="uuid">25169f0a-a8e6-4a00-a373-06607a08d237</entry>
Nov 28 18:54:19 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:54:19 user nova-compute[75203]:     </system>
Nov 28 18:54:19 user nova-compute[75203]:   </sysinfo>
Nov 28 18:54:19 user nova-compute[75203]:   <os>
Nov 28 18:54:19 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:54:19 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:54:19 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:54:19 user nova-compute[75203]:   </os>
Nov 28 18:54:19 user nova-compute[75203]:   <features>
Nov 28 18:54:19 user nova-compute[75203]:     <acpi/>
Nov 28 18:54:19 user nova-compute[75203]:     <apic/>
Nov 28 18:54:19 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:54:19 user nova-compute[75203]:   </features>
Nov 28 18:54:19 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:54:19 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:54:19 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:54:19 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:54:19 user nova-compute[75203]:   </clock>
Nov 28 18:54:19 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:54:19 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:54:19 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:54:19 user nova-compute[75203]:   </cpu>
Nov 28 18:54:19 user nova-compute[75203]:   <devices>
Nov 28 18:54:19 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:54:19 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:54:19 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk"/>
Nov 28 18:54:19 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:54:19 user nova-compute[75203]:     </disk>
Nov 28 18:54:19 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:54:19 user nova-compute[75203]:       <mac address="fa:16:3e:34:99:22"/>
Nov 28 18:54:19 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:54:19 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:54:19 user nova-compute[75203]:       <target dev="tap9b714a0d-a3"/>
Nov 28 18:54:19 user nova-compute[75203]:     </interface>
Nov 28 18:54:19 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:54:19 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/console.log" append="off"/>
Nov 28 18:54:19 user nova-compute[75203]:     </serial>
Nov 28 18:54:19 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:54:19 user nova-compute[75203]:     <video>
Nov 28 18:54:19 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:54:19 user nova-compute[75203]:     </video>
Nov 28 18:54:19 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:54:19 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:54:19 user nova-compute[75203]:     </rng>
Nov 28 18:54:19 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:54:19 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:54:19 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:54:19 user nova-compute[75203]:     </memballoon>
Nov 28 18:54:19 user nova-compute[75203]:   </devices>
Nov 28 18:54:19 user nova-compute[75203]: </domain>
Nov 28 18:54:19 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1610387206',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1610387206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1610387',id=35,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOaodbGfF/RG4WNOUNPUgIvoh9Mma2YwUkrY0QxiXIXvTWgRcR+BaMgXAP7JoJ7T6WAE7jFnguG1Y304LYRC2YxKUJOtXk1/X4Bn3LGZbwEQ1smu0Q8GbVsdcR2FKHFFQ==',key_name='tempest-keypair-1535421511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63f24bc0fa04465794db58c27a0d75f3',ramdisk_id='',reservation_id='r-tvqo0gna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1380192923',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f1489f9bd56496cac71675d6ae84be5',uuid=25169f0a-a8e6-4a00-a373-06607a08d237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Converting VIF {"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:99:22,bridge_name='br-int',has_traffic_filtering=True,id=9b714a0d-a38e-48e8-a118-2c76760365ef,network=Network(1138145a-b915-42b9-af5f-d852f71b250e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b714a0d-a3') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG os_vif [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:99:22,bridge_name='br-int',has_traffic_filtering=True,id=9b714a0d-a38e-48e8-a118-2c76760365ef,network=Network(1138145a-b915-42b9-af5f-d852f71b250e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b714a0d-a3') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5c47b38-e769-53b0-a4c8-61c6c63d96cb', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b714a0d-a3, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b714a0d-a3, col_values=(('qos', UUID('d205c47b-7254-461b-8154-37fde8ce59c6')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b714a0d-a3, col_values=(('external_ids', {'iface-id': '9b714a0d-a38e-48e8-a118-2c76760365ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:99:22', 'vm-uuid': '25169f0a-a8e6-4a00-a373-06607a08d237'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:54:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:19 user nova-compute[75203]: INFO os_vif [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:99:22,bridge_name='br-int',has_traffic_filtering=True,id=9b714a0d-a38e-48e8-a118-2c76760365ef,network=Network(1138145a-b915-42b9-af5f-d852f71b250e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b714a0d-a3')
Nov 28 18:54:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:54:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] No VIF found with MAC fa:16:3e:34:99:22, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:54:20 user nova-compute[75203]: DEBUG nova.network.neutron [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Updated VIF entry in instance network info cache for port 9b714a0d-a38e-48e8-a118-2c76760365ef. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:54:20 user nova-compute[75203]: DEBUG nova.network.neutron [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Updating instance_info_cache with network_info: [{"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:54:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5d6fd8d5-21f6-4330-9ea9-d021e39ef8a6 req-2a8bafab-caf1-42d2-97c1-05358147013a service nova] Releasing lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-d2b2c50e-dd5c-4af6-8fdf-18d89192dca5 req-2ef70154-e5d0-4930-bed7-a4b211cbe37b service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received event network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d2b2c50e-dd5c-4af6-8fdf-18d89192dca5 req-2ef70154-e5d0-4930-bed7-a4b211cbe37b service nova] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d2b2c50e-dd5c-4af6-8fdf-18d89192dca5 req-2ef70154-e5d0-4930-bed7-a4b211cbe37b service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d2b2c50e-dd5c-4af6-8fdf-18d89192dca5 req-2ef70154-e5d0-4930-bed7-a4b211cbe37b service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-d2b2c50e-dd5c-4af6-8fdf-18d89192dca5 req-2ef70154-e5d0-4930-bed7-a4b211cbe37b service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] No waiting events found dispatching network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:54:21 user nova-compute[75203]: WARNING nova.compute.manager [req-d2b2c50e-dd5c-4af6-8fdf-18d89192dca5 req-2ef70154-e5d0-4930-bed7-a4b211cbe37b service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received unexpected event network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef for instance with vm_state building and task_state spawning.
Nov 28 18:54:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:54:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Instance spawned successfully.
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:23 user nova-compute[75203]: INFO nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:54:23 user nova-compute[75203]: INFO nova.compute.manager [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Took 5.99 seconds to build instance.
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-159aa47e-aab3-4267-8191-4d47929e5975 req-dcd412fc-2e91-43a0-a53b-282dddb5ffc2 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received event network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-159aa47e-aab3-4267-8191-4d47929e5975 req-dcd412fc-2e91-43a0-a53b-282dddb5ffc2 service nova] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-159aa47e-aab3-4267-8191-4d47929e5975 req-dcd412fc-2e91-43a0-a53b-282dddb5ffc2 service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-159aa47e-aab3-4267-8191-4d47929e5975 req-dcd412fc-2e91-43a0-a53b-282dddb5ffc2 service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-159aa47e-aab3-4267-8191-4d47929e5975 req-dcd412fc-2e91-43a0-a53b-282dddb5ffc2 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] No waiting events found dispatching network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:54:23 user nova-compute[75203]: WARNING nova.compute.manager [req-159aa47e-aab3-4267-8191-4d47929e5975 req-dcd412fc-2e91-43a0-a53b-282dddb5ffc2 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received unexpected event network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef for instance with vm_state active and task_state None.
Nov 28 18:54:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1d69ed17-6ad5-47fd-87bb-9da3743bdd6b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.114s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:54:29 user nova-compute[75203]: INFO nova.compute.claims [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Claim successful on node user
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.network.neutron [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:54:29 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.policy [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e0355eaade04b2b9d377a6b2c78585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e597eb0284510980106d2de8c235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:54:29 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Creating image(s)
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk 1073741824" returned: 0 in 0.052s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG nova.network.neutron [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Successfully created port: 6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.206s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Cannot resize image /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Ensure instance console log exists: /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.neutron [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Successfully updated port: 6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquired lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.neutron [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-changed-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.compute.manager [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Refreshing instance network info cache due to event network-changed-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] Acquiring lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.neutron [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.neutron [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updating instance_info_cache with network_info: [{"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Releasing lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Instance network_info: |[{"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] Acquired lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.neutron [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Refreshing network info cache for port 6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Start _get_guest_xml network_info=[{"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:54:31 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:31 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-748511180',display_name='tempest-AttachVolumeNegativeTest-server-748511180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-748511180',id=36,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPWeR5bg1gxLrPEzHUVcs1NSvl7LnY9rcLZIeYj6lvqmOnbdKgH6WsY1BqBpCWXckjtdf8tmmOcT7XKoRhKBOjoHG07YwWM3rwMOSvI+3MxgFfTz80yk6pJ3vfRcUAC3w==',key_name='tempest-keypair-2078354765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-qcnfi106',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=e2437f09-319a-41c6-8c04-4ed01af3b1ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:70,bridge_name='br-int',has_traffic_filtering=True,id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff984b0-c4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.objects.instance [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'pci_devices' on Instance uuid e2437f09-319a-41c6-8c04-4ed01af3b1ba {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:54:31 user nova-compute[75203]:   <uuid>e2437f09-319a-41c6-8c04-4ed01af3b1ba</uuid>
Nov 28 18:54:31 user nova-compute[75203]:   <name>instance-00000024</name>
Nov 28 18:54:31 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:54:31 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:54:31 user nova-compute[75203]:   <metadata>
Nov 28 18:54:31 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:54:31 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:54:31 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeNegativeTest-server-748511180</nova:name>
Nov 28 18:54:31 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:54:31</nova:creationTime>
Nov 28 18:54:31 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:54:31 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:54:31 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:54:31 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:54:31 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:54:31 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:54:31 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:54:31 user nova-compute[75203]:       <nova:owner>
Nov 28 18:54:31 user nova-compute[75203]:         <nova:user uuid="7e0355eaade04b2b9d377a6b2c78585e">tempest-AttachVolumeNegativeTest-977864769-project-member</nova:user>
Nov 28 18:54:31 user nova-compute[75203]:         <nova:project uuid="d40e597eb0284510980106d2de8c235b">tempest-AttachVolumeNegativeTest-977864769</nova:project>
Nov 28 18:54:31 user nova-compute[75203]:       </nova:owner>
Nov 28 18:54:31 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:54:31 user nova-compute[75203]:       <nova:ports>
Nov 28 18:54:31 user nova-compute[75203]:         <nova:port uuid="6ff984b0-c437-4506-aa30-6dd7b2f9d3c7">
Nov 28 18:54:31 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 18:54:31 user nova-compute[75203]:         </nova:port>
Nov 28 18:54:31 user nova-compute[75203]:       </nova:ports>
Nov 28 18:54:31 user nova-compute[75203]:     </nova:instance>
Nov 28 18:54:31 user nova-compute[75203]:   </metadata>
Nov 28 18:54:31 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:54:31 user nova-compute[75203]:     <system>
Nov 28 18:54:31 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:54:31 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:54:31 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:54:31 user nova-compute[75203]:       <entry name="serial">e2437f09-319a-41c6-8c04-4ed01af3b1ba</entry>
Nov 28 18:54:31 user nova-compute[75203]:       <entry name="uuid">e2437f09-319a-41c6-8c04-4ed01af3b1ba</entry>
Nov 28 18:54:31 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:54:31 user nova-compute[75203]:     </system>
Nov 28 18:54:31 user nova-compute[75203]:   </sysinfo>
Nov 28 18:54:31 user nova-compute[75203]:   <os>
Nov 28 18:54:31 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:54:31 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:54:31 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:54:31 user nova-compute[75203]:   </os>
Nov 28 18:54:31 user nova-compute[75203]:   <features>
Nov 28 18:54:31 user nova-compute[75203]:     <acpi/>
Nov 28 18:54:31 user nova-compute[75203]:     <apic/>
Nov 28 18:54:31 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:54:31 user nova-compute[75203]:   </features>
Nov 28 18:54:31 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:54:31 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:54:31 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:54:31 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:54:31 user nova-compute[75203]:   </clock>
Nov 28 18:54:31 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:54:31 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:54:31 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:54:31 user nova-compute[75203]:   </cpu>
Nov 28 18:54:31 user nova-compute[75203]:   <devices>
Nov 28 18:54:31 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:54:31 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:54:31 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk"/>
Nov 28 18:54:31 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:54:31 user nova-compute[75203]:     </disk>
Nov 28 18:54:31 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:54:31 user nova-compute[75203]:       <mac address="fa:16:3e:a4:f0:70"/>
Nov 28 18:54:31 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:54:31 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:54:31 user nova-compute[75203]:       <target dev="tap6ff984b0-c4"/>
Nov 28 18:54:31 user nova-compute[75203]:     </interface>
Nov 28 18:54:31 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:54:31 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/console.log" append="off"/>
Nov 28 18:54:31 user nova-compute[75203]:     </serial>
Nov 28 18:54:31 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:54:31 user nova-compute[75203]:     <video>
Nov 28 18:54:31 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:54:31 user nova-compute[75203]:     </video>
Nov 28 18:54:31 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:54:31 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:54:31 user nova-compute[75203]:     </rng>
Nov 28 18:54:31 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:54:31 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:54:31 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:54:31 user nova-compute[75203]:     </memballoon>
Nov 28 18:54:31 user nova-compute[75203]:   </devices>
Nov 28 18:54:31 user nova-compute[75203]: </domain>
Nov 28 18:54:31 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-748511180',display_name='tempest-AttachVolumeNegativeTest-server-748511180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-748511180',id=36,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPWeR5bg1gxLrPEzHUVcs1NSvl7LnY9rcLZIeYj6lvqmOnbdKgH6WsY1BqBpCWXckjtdf8tmmOcT7XKoRhKBOjoHG07YwWM3rwMOSvI+3MxgFfTz80yk6pJ3vfRcUAC3w==',key_name='tempest-keypair-2078354765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-qcnfi106',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=e2437f09-319a-41c6-8c04-4ed01af3b1ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:70,bridge_name='br-int',has_traffic_filtering=True,id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff984b0-c4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG os_vif [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:70,bridge_name='br-int',has_traffic_filtering=True,id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff984b0-c4') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2774ae3f-0533-5cb5-8036-d01fe08a0f7d', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ff984b0-c4, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ff984b0-c4, col_values=(('qos', UUID('dee768fc-a6e6-4658-9da0-ddd8144a2c6c')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ff984b0-c4, col_values=(('external_ids', {'iface-id': '6ff984b0-c437-4506-aa30-6dd7b2f9d3c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:f0:70', 'vm-uuid': 'e2437f09-319a-41c6-8c04-4ed01af3b1ba'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:31 user nova-compute[75203]: INFO os_vif [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:f0:70,bridge_name='br-int',has_traffic_filtering=True,id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff984b0-c4')
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:54:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No VIF found with MAC fa:16:3e:a4:f0:70, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:54:32 user nova-compute[75203]: DEBUG nova.network.neutron [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updated VIF entry in instance network info cache for port 6ff984b0-c437-4506-aa30-6dd7b2f9d3c7. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:54:32 user nova-compute[75203]: DEBUG nova.network.neutron [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updating instance_info_cache with network_info: [{"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:54:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0ec4bd77-dc90-4851-8a07-00cb2f02bd39 req-4766bd7e-b700-42c1-bb36-7c57820fd7ee service nova] Releasing lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-e1d076c1-ded8-4312-8853-de8c278973f9 req-27f4d9c3-51eb-4b5a-908d-3c7c7d358bbc service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e1d076c1-ded8-4312-8853-de8c278973f9 req-27f4d9c3-51eb-4b5a-908d-3c7c7d358bbc service nova] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e1d076c1-ded8-4312-8853-de8c278973f9 req-27f4d9c3-51eb-4b5a-908d-3c7c7d358bbc service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e1d076c1-ded8-4312-8853-de8c278973f9 req-27f4d9c3-51eb-4b5a-908d-3c7c7d358bbc service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-e1d076c1-ded8-4312-8853-de8c278973f9 req-27f4d9c3-51eb-4b5a-908d-3c7c7d358bbc service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] No waiting events found dispatching network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:54:33 user nova-compute[75203]: WARNING nova.compute.manager [req-e1d076c1-ded8-4312-8853-de8c278973f9 req-27f4d9c3-51eb-4b5a-908d-3c7c7d358bbc service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received unexpected event network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 for instance with vm_state building and task_state spawning.
Nov 28 18:54:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a833a5bd-a28d-4843-9e6d-b4f8e3b76ca4 req-4e8c5f2b-6c3a-48c3-874a-144d479850f3 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a833a5bd-a28d-4843-9e6d-b4f8e3b76ca4 req-4e8c5f2b-6c3a-48c3-874a-144d479850f3 service nova] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a833a5bd-a28d-4843-9e6d-b4f8e3b76ca4 req-4e8c5f2b-6c3a-48c3-874a-144d479850f3 service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a833a5bd-a28d-4843-9e6d-b4f8e3b76ca4 req-4e8c5f2b-6c3a-48c3-874a-144d479850f3 service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.compute.manager [req-a833a5bd-a28d-4843-9e6d-b4f8e3b76ca4 req-4e8c5f2b-6c3a-48c3-874a-144d479850f3 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] No waiting events found dispatching network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:54:35 user nova-compute[75203]: WARNING nova.compute.manager [req-a833a5bd-a28d-4843-9e6d-b4f8e3b76ca4 req-4e8c5f2b-6c3a-48c3-874a-144d479850f3 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received unexpected event network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 for instance with vm_state building and task_state spawning.
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:54:35 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Instance spawned successfully.
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:35 user nova-compute[75203]: INFO nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 28 18:54:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:54:35 user nova-compute[75203]: INFO nova.compute.manager [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Took 6.60 seconds to build instance.
Nov 28 18:54:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-793dc68f-a194-4c8a-a026-7221f1050918 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.705s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:50 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:50 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:54:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:54:51 user nova-compute[75203]: INFO nova.compute.claims [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Claim successful on node user
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:51 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:54:52 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.policy [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a95b00fbf38d4d9b852837c31a4cca68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539e02b4366e46878557f18ea375a24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:54:52 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Creating image(s)
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk 1073741824" returned: 0 in 0.050s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.network.neutron [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Successfully created port: a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:52 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Cannot resize image /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Ensure instance console log exists: /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Successfully updated port: a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-changed-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Refreshing instance network info cache due to event network-changed-a9646837-d0bd-408a-9b59-b36ee39c6ab2. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:54:53 user nova-compute[75203]: DEBUG nova.network.neutron [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:54:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=24.797168731689453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 25169f0a-a8e6-4a00-a373-06607a08d237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2437f09-319a-41c6-8c04-4ed01af3b1ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.neutron [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance network_info: |[{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Refreshing network info cache for port a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Start _get_guest_xml network_info=[{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:54:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.objects.instance [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'pci_devices' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:54:54 user nova-compute[75203]:   <uuid>17161f39-18b4-488b-871d-bc8e9e8faa00</uuid>
Nov 28 18:54:54 user nova-compute[75203]:   <name>instance-00000025</name>
Nov 28 18:54:54 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:54:54 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:54:54 user nova-compute[75203]:   <metadata>
Nov 28 18:54:54 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:54:54 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:54:54 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeTestJSON-server-1378465901</nova:name>
Nov 28 18:54:54 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:54:54</nova:creationTime>
Nov 28 18:54:54 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:54:54 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:54:54 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:54:54 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:54:54 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:54:54 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:54:54 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:54:54 user nova-compute[75203]:       <nova:owner>
Nov 28 18:54:54 user nova-compute[75203]:         <nova:user uuid="a95b00fbf38d4d9b852837c31a4cca68">tempest-AttachVolumeTestJSON-1450919923-project-member</nova:user>
Nov 28 18:54:54 user nova-compute[75203]:         <nova:project uuid="539e02b4366e46878557f18ea375a24a">tempest-AttachVolumeTestJSON-1450919923</nova:project>
Nov 28 18:54:54 user nova-compute[75203]:       </nova:owner>
Nov 28 18:54:54 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:54:54 user nova-compute[75203]:       <nova:ports>
Nov 28 18:54:54 user nova-compute[75203]:         <nova:port uuid="a9646837-d0bd-408a-9b59-b36ee39c6ab2">
Nov 28 18:54:54 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 18:54:54 user nova-compute[75203]:         </nova:port>
Nov 28 18:54:54 user nova-compute[75203]:       </nova:ports>
Nov 28 18:54:54 user nova-compute[75203]:     </nova:instance>
Nov 28 18:54:54 user nova-compute[75203]:   </metadata>
Nov 28 18:54:54 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:54:54 user nova-compute[75203]:     <system>
Nov 28 18:54:54 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:54:54 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:54:54 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:54:54 user nova-compute[75203]:       <entry name="serial">17161f39-18b4-488b-871d-bc8e9e8faa00</entry>
Nov 28 18:54:54 user nova-compute[75203]:       <entry name="uuid">17161f39-18b4-488b-871d-bc8e9e8faa00</entry>
Nov 28 18:54:54 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:54:54 user nova-compute[75203]:     </system>
Nov 28 18:54:54 user nova-compute[75203]:   </sysinfo>
Nov 28 18:54:54 user nova-compute[75203]:   <os>
Nov 28 18:54:54 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:54:54 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:54:54 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:54:54 user nova-compute[75203]:   </os>
Nov 28 18:54:54 user nova-compute[75203]:   <features>
Nov 28 18:54:54 user nova-compute[75203]:     <acpi/>
Nov 28 18:54:54 user nova-compute[75203]:     <apic/>
Nov 28 18:54:54 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:54:54 user nova-compute[75203]:   </features>
Nov 28 18:54:54 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:54:54 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:54:54 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:54:54 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:54:54 user nova-compute[75203]:   </clock>
Nov 28 18:54:54 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:54:54 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:54:54 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:54:54 user nova-compute[75203]:   </cpu>
Nov 28 18:54:54 user nova-compute[75203]:   <devices>
Nov 28 18:54:54 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:54:54 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:54:54 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk"/>
Nov 28 18:54:54 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:54:54 user nova-compute[75203]:     </disk>
Nov 28 18:54:54 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:54:54 user nova-compute[75203]:       <mac address="fa:16:3e:4f:07:14"/>
Nov 28 18:54:54 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:54:54 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:54:54 user nova-compute[75203]:       <target dev="tapa9646837-d0"/>
Nov 28 18:54:54 user nova-compute[75203]:     </interface>
Nov 28 18:54:54 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:54:54 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/console.log" append="off"/>
Nov 28 18:54:54 user nova-compute[75203]:     </serial>
Nov 28 18:54:54 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:54:54 user nova-compute[75203]:     <video>
Nov 28 18:54:54 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:54:54 user nova-compute[75203]:     </video>
Nov 28 18:54:54 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:54:54 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:54:54 user nova-compute[75203]:     </rng>
Nov 28 18:54:54 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:54:54 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:54:54 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:54:54 user nova-compute[75203]:     </memballoon>
Nov 28 18:54:54 user nova-compute[75203]:   </devices>
Nov 28 18:54:54 user nova-compute[75203]: </domain>
Nov 28 18:54:54 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG os_vif [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95e3c0ce-1fa7-5bfc-abe6-2c5bd3c7fe69', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9646837-d0, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9646837-d0, col_values=(('qos', UUID('49c3357b-1188-474f-919f-74ad5d585e56')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9646837-d0, col_values=(('external_ids', {'iface-id': 'a9646837-d0bd-408a-9b59-b36ee39c6ab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:07:14', 'vm-uuid': '17161f39-18b4-488b-871d-bc8e9e8faa00'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:54 user nova-compute[75203]: INFO os_vif [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0')
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No VIF found with MAC fa:16:3e:4f:07:14, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updated VIF entry in instance network info cache for port a9646837-d0bd-408a-9b59-b36ee39c6ab2. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:54:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-158ba5d5-729f-4992-a1b4-21e6e1b1ce86 req-e161607c-2798-4070-8df6-43c6bc48026c service nova] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-d083c43a-60ea-448d-be37-6d6e408b6c88 req-84a1fb00-8069-4e3c-8190-56f044d60004 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d083c43a-60ea-448d-be37-6d6e408b6c88 req-84a1fb00-8069-4e3c-8190-56f044d60004 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d083c43a-60ea-448d-be37-6d6e408b6c88 req-84a1fb00-8069-4e3c-8190-56f044d60004 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d083c43a-60ea-448d-be37-6d6e408b6c88 req-84a1fb00-8069-4e3c-8190-56f044d60004 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-d083c43a-60ea-448d-be37-6d6e408b6c88 req-84a1fb00-8069-4e3c-8190-56f044d60004 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:54:55 user nova-compute[75203]: WARNING nova.compute.manager [req-d083c43a-60ea-448d-be37-6d6e408b6c88 req-84a1fb00-8069-4e3c-8190-56f044d60004 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state building and task_state spawning.
Nov 28 18:54:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:54:57 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance spawned successfully.
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:54:57 user nova-compute[75203]: INFO nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 28 18:54:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:54:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-2461a8a8-324f-4078-8f24-2e6931a7c465 req-16143611-1ee1-42a4-a6b7-a31b35bb71dd service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:54:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2461a8a8-324f-4078-8f24-2e6931a7c465 req-16143611-1ee1-42a4-a6b7-a31b35bb71dd service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:54:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2461a8a8-324f-4078-8f24-2e6931a7c465 req-16143611-1ee1-42a4-a6b7-a31b35bb71dd service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:54:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2461a8a8-324f-4078-8f24-2e6931a7c465 req-16143611-1ee1-42a4-a6b7-a31b35bb71dd service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-2461a8a8-324f-4078-8f24-2e6931a7c465 req-16143611-1ee1-42a4-a6b7-a31b35bb71dd service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:54:58 user nova-compute[75203]: WARNING nova.compute.manager [req-2461a8a8-324f-4078-8f24-2e6931a7c465 req-16143611-1ee1-42a4-a6b7-a31b35bb71dd service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state building and task_state spawning.
Nov 28 18:54:58 user nova-compute[75203]: INFO nova.compute.manager [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Took 6.60 seconds to build instance.
Nov 28 18:54:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-121a249e-e5bb-4f7a-bc51-ba7a6a25b691 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.710s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:54:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:54:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:54:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:54:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid e170916d-ac84-400b-96b6-62d4b5919980 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-changed-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Refreshing instance network info cache due to event network-changed-8a2aa4e0-83a7-4020-b31e-f57b1a32a057. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] Acquiring lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] Acquired lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.network.neutron [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Refreshing network info cache for port 8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'flavor' on Instance uuid 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Ignoring supplied device name: /dev/vdb
Nov 28 18:55:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:01 user nova-compute[75203]: INFO nova.compute.manager [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Attaching volume 46af9cc0-7039-44f1-baff-621375f8332b to /dev/vdb
Nov 28 18:55:01 user nova-compute[75203]: DEBUG os_brick.utils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86089a-8ab8-4000-bb6c-7c528d8ee403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1863dc14-4d0a-4064-bfaf-1c1e8ae037b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ead94-d33b-4d97-8043-5d0334ad44a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bef4a4-eba4-4be1-bfe8-9ca4e6d9ddbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Updated VIF entry in instance network info cache for port 8a2aa4e0-83a7-4020-b31e-f57b1a32a057. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Updating instance_info_cache with network_info: [{"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:55:01 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4834f089-f5d3-4ba8-ba85-36b665b58383]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG os_brick.utils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Updating existing volume attachment record: 20e5dd51-2326-4aa2-a103-5d1ad7e11e3f {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:55:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1e71f178-76b7-4546-93bf-8e568bbeb7d8 req-0d7ee7be-8b2c-44f0-b5b7-17a9559ec09e service nova] Releasing lock "refresh_cache-48b0d74c-5f15-4a92-bc25-20f89c6d56c7" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:55:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTCJXHQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:55:08 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:55:08 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:55:08 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b715a3-3fc8-42e1-9a6f-4915a611bc8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:55:08 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99a4740-dd31-418d-9ddd-5229e98ad823]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b] added
Nov 28 18:55:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc432f4-764a-4143-9ba0-a613d8ae0441]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8315d099-ae94-4d4e-b4db-1fc916d11967]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTCJXHQV {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTCJXHQV" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1566e1de-4916-4261-a148-a28cc111cb29]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sTCJXHQV'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[239bca53-b43c-4bcd-a606-4021e21d36c7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[55985928-25c8-44b6-8171-5f0345930e7b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:08 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:08 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:08 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:08 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:08 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:55:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --login" returned: 0 in 1.062s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08f5db7-ffe2-4a4a-8fca-c5818d581446]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260]
Nov 28 18:55:09 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260] successful.
Nov 28 18:55:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28b80b1-1568-4f6a-b616-5acf2419fb3a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bedbfd-1185-47bd-bc1f-2d028ea77aad]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:09 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:09 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:09 user nova-compute[75203]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)
Nov 28 18:55:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:09 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:09 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:09 user nova-compute[75203]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)
Nov 28 18:55:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.271s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c36de61-e422-4313-a19e-3b06893541b9]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:55:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTCJXHQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:55:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.306s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:55:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== connect_volume: return (2308ms) {'type': 'block', 'scsi_wwn': '26338333964323231', 'path': '/dev/sde'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:55:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338333964323231', 'path': '/dev/sde'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:55:10 user nova-compute[75203]: DEBUG nova.objects.instance [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'flavor' on Instance uuid 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:55:10 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:55:10 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:55:10 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:55:10 user nova-compute[75203]:   <serial>46af9cc0-7039-44f1-baff-621375f8332b</serial>
Nov 28 18:55:10 user nova-compute[75203]: </disk>
Nov 28 18:55:10 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:55:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:55:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:55:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] No VIF found with MAC fa:16:3e:02:55:7a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:55:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-925675e0-9711-4604-9833-78b333cca556 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.289s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:22 user nova-compute[75203]: INFO nova.compute.manager [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Rescuing
Nov 28 18:55:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:55:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:55:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:55:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating instance_info_cache with network_info: [{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-77013c5a-de75-43c2-838b-0171774e8bd3 req-426deb06-1b39-410b-afe8-2bc9c2fc07cd service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77013c5a-de75-43c2-838b-0171774e8bd3 req-426deb06-1b39-410b-afe8-2bc9c2fc07cd service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77013c5a-de75-43c2-838b-0171774e8bd3 req-426deb06-1b39-410b-afe8-2bc9c2fc07cd service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-77013c5a-de75-43c2-838b-0171774e8bd3 req-426deb06-1b39-410b-afe8-2bc9c2fc07cd service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-77013c5a-de75-43c2-838b-0171774e8bd3 req-426deb06-1b39-410b-afe8-2bc9c2fc07cd service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:23 user nova-compute[75203]: WARNING nova.compute.manager [req-77013c5a-de75-43c2-838b-0171774e8bd3 req-426deb06-1b39-410b-afe8-2bc9c2fc07cd service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state active and task_state rescuing.
Nov 28 18:55:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance destroyed successfully.
Nov 28 18:55:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Attempting a stable device rescue
Nov 28 18:55:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75203) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance directory exists: not creating {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 28 18:55:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Creating image(s)
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "/opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "/opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG nova.objects.instance [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "313be65ec5f1bdcbe5f40b661f19b293b14cada4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "313be65ec5f1bdcbe5f40b661f19b293b14cada4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.virt.images [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] 1cd12d44-0b21-4f45-94b7-074d8946b924 was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.part /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-62c96693-49a1-40cf-b1b2-f44b2a7d8310 req-97306094-c089-4326-b232-346a810f852c service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62c96693-49a1-40cf-b1b2-f44b2a7d8310 req-97306094-c089-4326-b232-346a810f852c service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62c96693-49a1-40cf-b1b2-f44b2a7d8310 req-97306094-c089-4326-b232-346a810f852c service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62c96693-49a1-40cf-b1b2-f44b2a7d8310 req-97306094-c089-4326-b232-346a810f852c service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-62c96693-49a1-40cf-b1b2-f44b2a7d8310 req-97306094-c089-4326-b232-346a810f852c service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:25 user nova-compute[75203]: WARNING nova.compute.manager [req-62c96693-49a1-40cf-b1b2-f44b2a7d8310 req-97306094-c089-4326-b232-346a810f852c service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state active and task_state rescuing.
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.part /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.converted" returned: 0 in 0.274s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "313be65ec5f1bdcbe5f40b661f19b293b14cada4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.734s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "313be65ec5f1bdcbe5f40b661f19b293b14cada4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "313be65ec5f1bdcbe5f40b661f19b293b14cada4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4 --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4,backing_fmt=raw /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4,backing_fmt=raw /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue" returned: 0 in 0.120s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "313be65ec5f1bdcbe5f40b661f19b293b14cada4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.objects.instance [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'migration_context' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.objects.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<43144e1b-45b4-4d5e-b81b-4246a96f3c1d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Start _get_guest_xml network_info=[{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "vif_mac": "fa:16:3e:6e:25:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1cd12d44-0b21-4f45-94b7-074d8946b924', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKGNabSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '43144e1b-45b4-4d5e-b81b-4246a96f3c1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a604db6c-1a43-4dc4-9c8a-8d922675c822', 'serial': 'a604db6c-1a43-4dc4-9c8a-8d922675c822'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'fc1aef18-75cd-4277-ab75-10d90ecb9332', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.objects.instance [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'resources' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.objects.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<43144e1b-45b4-4d5e-b81b-4246a96f3c1d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:55:25 user nova-compute[75203]: DEBUG nova.objects.instance [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'numa_topology' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.objects.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<43144e1b-45b4-4d5e-b81b-4246a96f3c1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:55:26 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:55:26 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.objects.instance [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.objects.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<43144e1b-45b4-4d5e-b81b-4246a96f3c1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKGNabSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:55:26 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:55:26 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:55:26 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292eb3f-0177-462b-8f81-af0fcf8e348d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LKGNabSq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 28 18:55:26 user nova-compute[75203]: node.name = iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:55:26 user nova-compute[75203]: node.tpgt = -1
Nov 28 18:55:26 user nova-compute[75203]: node.startup = automatic
Nov 28 18:55:26 user nova-compute[75203]: node.leading_login = No
Nov 28 18:55:26 user nova-compute[75203]: iface.iscsi_ifacename = default
Nov 28 18:55:26 user nova-compute[75203]: iface.net_ifacename = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.ipaddress = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.prefix_len = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.hwaddress = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.transport_name = tcp
Nov 28 18:55:26 user nova-compute[75203]: iface.initiatorname = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.state = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.vlan_id = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.vlan_priority = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.vlan_state = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.iface_num = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.mtu = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.port = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.bootproto = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.subnet_mask = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.gateway = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_alt_client_id_state = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_alt_client_id = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_dns = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_learn_iqn = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_req_vendor_id_state = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_vendor_id_state = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_vendor_id = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.dhcp_slp_da = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.fragmentation = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.gratuitous_arp = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.incoming_forwarding = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.tos_state = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.tos = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.ttl = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.delayed_ack = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.tcp_nagle = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.tcp_wsf_state = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.tcp_wsf = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.tcp_timer_scale = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.tcp_timestamp = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.redirect = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.def_task_mgmt_timeout = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.header_digest = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.data_digest = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.immediate_data = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.initial_r2t = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.data_seq_inorder = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.data_pdu_inorder = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.erl = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.max_receive_data_len = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.first_burst_len = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.max_outstanding_r2t = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.max_burst_len = 0
Nov 28 18:55:26 user nova-compute[75203]: iface.chap_auth = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.bidi_chap = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.strict_login_compliance = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.discovery_auth = <empty>
Nov 28 18:55:26 user nova-compute[75203]: iface.discovery_logout = <empty>
Nov 28 18:55:26 user nova-compute[75203]: node.discovery_address = <empty>
Nov 28 18:55:26 user nova-compute[75203]: node.discovery_port = 0
Nov 28 18:55:26 user nova-compute[75203]: node.discovery_type = static
Nov 28 18:55:26 user nova-compute[75203]: node.session.initial_cmdsn = 0
Nov 28 18:55:26 user nova-compute[75203]: node.session.initial_login_retry_max = 8
Nov 28 18:55:26 user nova-compute[75203]: node.session.xmit_thread_priority = -20
Nov 28 18:55:26 user nova-compute[75203]: node.session.cmds_max = 128
Nov 28 18:55:26 user nova-compute[75203]: node.session.queue_depth = 32
Nov 28 18:55:26 user nova-compute[75203]: node.session.nr_sessions = 1
Nov 28 18:55:26 user nova-compute[75203]: node.session.auth.authmethod = CHAP
Nov 28 18:55:26 user nova-compute[75203]: node.session.auth.username = LKGNabSq
Nov 28 18:55:26 user nova-compute[75203]: node.session.auth.password = ***
Nov 28 18:55:26 user nova-compute[75203]: node.session.auth.username_in = <empty>
Nov 28 18:55:26 user nova-compute[75203]: node.session.auth.password_in = <empty>
Nov 28 18:55:26 user nova-compute[75203]: node.session.auth.chap_algs = MD5
Nov 28 18:55:26 user nova-compute[75203]: node.session.timeo.replacement_timeout = 120
Nov 28 18:55:26 user nova-compute[75203]: node.session.err_timeo.abort_timeout = 15
Nov 28 18:55:26 user nova-compute[75203]: node.session.err_timeo.lu_reset_timeout = 30
Nov 28 18:55:26 user nova-compute[75203]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 28 18:55:26 user nova-compute[75203]: node.session.err_timeo.host_reset_timeout = 60
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.FastAbort = Yes
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.InitialR2T = No
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.ImmediateData = Yes
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.FirstBurstLength = 262144
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.MaxBurstLength = 16776192
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.DefaultTime2Retain = 0
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.DefaultTime2Wait = 2
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.MaxConnections = 1
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 28 18:55:26 user nova-compute[75203]: node.session.iscsi.ERL = 0
Nov 28 18:55:26 user nova-compute[75203]: node.session.scan = manual
Nov 28 18:55:26 user nova-compute[75203]: node.session.reopen_max = 0
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].address = 172.16.0.220
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].port = 3260
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].startup = manual
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].tcp.window_size = 524288
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].tcp.type_of_service = 0
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].timeo.logout_timeout = 15
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].timeo.login_timeout = 15
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].timeo.auth_timeout = 45
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].timeo.noop_out_interval = 5
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].timeo.noop_out_timeout = 5
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].iscsi.HeaderDigest = None
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].iscsi.DataDigest = None
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].iscsi.IFMarker = No
Nov 28 18:55:26 user nova-compute[75203]: node.conn[0].iscsi.OFMarker = No
Nov 28 18:55:26 user nova-compute[75203]: # END RECORD
Nov 28 18:55:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8629b-4808-4308-8b2e-45160cba4154]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e23f2e-f4fc-4d8e-86ed-253e1835253d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKGNabSq {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKGNabSq" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[205f9fc9-5426-45fd-a0f1-448202604297]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKGNabSq'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0cd7a2-2ec6-4e33-a1aa-6b170bc7d84a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73528ab-f123-40fe-820e-4fb47340e879]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:26 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:26 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:26 user nova-compute[75203]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)
Nov 28 18:55:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:26 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:26 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:26 user nova-compute[75203]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)
Nov 28 18:55:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] HCTL ('35', '0', '0', 0) found on session 35 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac98de7-0b71-4d36-9819-1f802da9e2d5]: (4, ('0 0 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Searching for a device in session 35 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKGNabSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '26466303036313931', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466303036313931', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967500111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967500111',id=34,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-nx6ujcs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:54:00Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=43144e1b-45b4-4d5e-b81b-4246a96f3c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "vif_mac": "fa:16:3e:6e:25:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "vif_mac": "fa:16:3e:6e:25:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.objects.instance [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'pci_devices' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.objects.base [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Object Instance<43144e1b-45b4-4d5e-b81b-4246a96f3c1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:55:26 user nova-compute[75203]:   <uuid>43144e1b-45b4-4d5e-b81b-4246a96f3c1d</uuid>
Nov 28 18:55:26 user nova-compute[75203]:   <name>instance-00000022</name>
Nov 28 18:55:26 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:55:26 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:55:26 user nova-compute[75203]:   <metadata>
Nov 28 18:55:26 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:55:26 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:55:26 user nova-compute[75203]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1967500111</nova:name>
Nov 28 18:55:26 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:55:26</nova:creationTime>
Nov 28 18:55:26 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:55:26 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:55:26 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:55:26 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:55:26 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:55:26 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:55:26 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:55:26 user nova-compute[75203]:       <nova:owner>
Nov 28 18:55:26 user nova-compute[75203]:         <nova:user uuid="ad9a9772df954da0b42b5b102440c1d0">tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member</nova:user>
Nov 28 18:55:26 user nova-compute[75203]:         <nova:project uuid="eec1aaec341d441fb4da4fc53a985617">tempest-ServerBootFromVolumeStableRescueTest-1173209255</nova:project>
Nov 28 18:55:26 user nova-compute[75203]:       </nova:owner>
Nov 28 18:55:26 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:55:26 user nova-compute[75203]:       <nova:ports>
Nov 28 18:55:26 user nova-compute[75203]:         <nova:port uuid="7ce60268-403d-4ac8-ac63-c01d13e9e3f5">
Nov 28 18:55:26 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 18:55:26 user nova-compute[75203]:         </nova:port>
Nov 28 18:55:26 user nova-compute[75203]:       </nova:ports>
Nov 28 18:55:26 user nova-compute[75203]:     </nova:instance>
Nov 28 18:55:26 user nova-compute[75203]:   </metadata>
Nov 28 18:55:26 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:55:26 user nova-compute[75203]:     <system>
Nov 28 18:55:26 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:55:26 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:55:26 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:55:26 user nova-compute[75203]:       <entry name="serial">43144e1b-45b4-4d5e-b81b-4246a96f3c1d</entry>
Nov 28 18:55:26 user nova-compute[75203]:       <entry name="uuid">43144e1b-45b4-4d5e-b81b-4246a96f3c1d</entry>
Nov 28 18:55:26 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:55:26 user nova-compute[75203]:     </system>
Nov 28 18:55:26 user nova-compute[75203]:   </sysinfo>
Nov 28 18:55:26 user nova-compute[75203]:   <os>
Nov 28 18:55:26 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:55:26 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:55:26 user nova-compute[75203]:   </os>
Nov 28 18:55:26 user nova-compute[75203]:   <features>
Nov 28 18:55:26 user nova-compute[75203]:     <acpi/>
Nov 28 18:55:26 user nova-compute[75203]:     <apic/>
Nov 28 18:55:26 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:55:26 user nova-compute[75203]:   </features>
Nov 28 18:55:26 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:55:26 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:55:26 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:55:26 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:55:26 user nova-compute[75203]:   </clock>
Nov 28 18:55:26 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:55:26 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:55:26 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:55:26 user nova-compute[75203]:   </cpu>
Nov 28 18:55:26 user nova-compute[75203]:   <devices>
Nov 28 18:55:26 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:55:26 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:55:26 user nova-compute[75203]:       <source dev="/dev/sdd"/>
Nov 28 18:55:26 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:55:26 user nova-compute[75203]:       <serial>a604db6c-1a43-4dc4-9c8a-8d922675c822</serial>
Nov 28 18:55:26 user nova-compute[75203]:     </disk>
Nov 28 18:55:26 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:55:26 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:55:26 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue"/>
Nov 28 18:55:26 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:55:26 user nova-compute[75203]:       <boot order="1"/>
Nov 28 18:55:26 user nova-compute[75203]:     </disk>
Nov 28 18:55:26 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:55:26 user nova-compute[75203]:       <mac address="fa:16:3e:6e:25:e5"/>
Nov 28 18:55:26 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:55:26 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:55:26 user nova-compute[75203]:       <target dev="tap7ce60268-40"/>
Nov 28 18:55:26 user nova-compute[75203]:     </interface>
Nov 28 18:55:26 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:55:26 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/console.log" append="off"/>
Nov 28 18:55:26 user nova-compute[75203]:     </serial>
Nov 28 18:55:26 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:55:26 user nova-compute[75203]:     <video>
Nov 28 18:55:26 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:55:26 user nova-compute[75203]:     </video>
Nov 28 18:55:26 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:55:26 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:55:26 user nova-compute[75203]:     </rng>
Nov 28 18:55:26 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:55:26 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:55:26 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:55:26 user nova-compute[75203]:     </memballoon>
Nov 28 18:55:26 user nova-compute[75203]:   </devices>
Nov 28 18:55:26 user nova-compute[75203]: </domain>
Nov 28 18:55:26 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:55:26 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance destroyed successfully.
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:55:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] No VIF found with MAC fa:16:3e:6e:25:e5, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG nova.compute.manager [req-7d551424-ef06-437c-ac81-ecad82b0f3b5 req-8bbb0f01-5a55-44f3-ae99-a5c174b1488b service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7d551424-ef06-437c-ac81-ecad82b0f3b5 req-8bbb0f01-5a55-44f3-ae99-a5c174b1488b service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7d551424-ef06-437c-ac81-ecad82b0f3b5 req-8bbb0f01-5a55-44f3-ae99-a5c174b1488b service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7d551424-ef06-437c-ac81-ecad82b0f3b5 req-8bbb0f01-5a55-44f3-ae99-a5c174b1488b service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG nova.compute.manager [req-7d551424-ef06-437c-ac81-ecad82b0f3b5 req-8bbb0f01-5a55-44f3-ae99-a5c174b1488b service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:27 user nova-compute[75203]: WARNING nova.compute.manager [req-7d551424-ef06-437c-ac81-ecad82b0f3b5 req-8bbb0f01-5a55-44f3-ae99-a5c174b1488b service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state active and task_state rescuing.
Nov 28 18:55:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:28 user nova-compute[75203]: INFO nova.compute.manager [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Detaching volume 46af9cc0-7039-44f1-baff-621375f8332b
Nov 28 18:55:28 user nova-compute[75203]: INFO nova.virt.block_device [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Attempting to driver detach volume 46af9cc0-7039-44f1-baff-621375f8332b from mountpoint /dev/vdb
Nov 28 18:55:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Attempting to detach device vdb from instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:55:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:55:28 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:55:28 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:55:28 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:55:28 user nova-compute[75203]:   <serial>46af9cc0-7039-44f1-baff-621375f8332b</serial>
Nov 28 18:55:28 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:55:28 user nova-compute[75203]: </disk>
Nov 28 18:55:28 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:55:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully detached device vdb from instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 from the persistent domain config.
Nov 28 18:55:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:55:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:55:28 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:55:28 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:55:28 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:55:28 user nova-compute[75203]:   <serial>46af9cc0-7039-44f1-baff-621375f8332b</serial>
Nov 28 18:55:28 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:55:28 user nova-compute[75203]: </disk>
Nov 28 18:55:28 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:55:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:55:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-23f18c25-5adb-4a3c-8d27-7675e5035211 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:55:29 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c9abbb8-96df-4d2c-9910-716a51620e0e req-c90bc55b-2e92-4748-adbc-9e6e2a8e0d8f service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c9abbb8-96df-4d2c-9910-716a51620e0e req-c90bc55b-2e92-4748-adbc-9e6e2a8e0d8f service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c9abbb8-96df-4d2c-9910-716a51620e0e req-c90bc55b-2e92-4748-adbc-9e6e2a8e0d8f service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c9abbb8-96df-4d2c-9910-716a51620e0e req-c90bc55b-2e92-4748-adbc-9e6e2a8e0d8f service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:29 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c9abbb8-96df-4d2c-9910-716a51620e0e req-c90bc55b-2e92-4748-adbc-9e6e2a8e0d8f service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:29 user nova-compute[75203]: WARNING nova.compute.manager [req-3c9abbb8-96df-4d2c-9910-716a51620e0e req-c90bc55b-2e92-4748-adbc-9e6e2a8e0d8f service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state rescued and task_state None.
Nov 28 18:55:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:36 user nova-compute[75203]: INFO nova.compute.manager [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Unrescuing
Nov 28 18:55:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:55:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:55:36 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:55:36 user nova-compute[75203]: DEBUG nova.network.neutron [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:55:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:55:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'flavor' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-733e7f07-6559-4d4a-9e50-4c0dd5a11dd0 req-50f3b4e9-9612-4311-ac06-d5fc72089070 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-733e7f07-6559-4d4a-9e50-4c0dd5a11dd0 req-50f3b4e9-9612-4311-ac06-d5fc72089070 service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-733e7f07-6559-4d4a-9e50-4c0dd5a11dd0 req-50f3b4e9-9612-4311-ac06-d5fc72089070 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-733e7f07-6559-4d4a-9e50-4c0dd5a11dd0 req-50f3b4e9-9612-4311-ac06-d5fc72089070 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-733e7f07-6559-4d4a-9e50-4c0dd5a11dd0 req-50f3b4e9-9612-4311-ac06-d5fc72089070 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:37 user nova-compute[75203]: WARNING nova.compute.manager [req-733e7f07-6559-4d4a-9e50-4c0dd5a11dd0 req-50f3b4e9-9612-4311-ac06-d5fc72089070 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:55:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing instance network info cache due to event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG nova.network.neutron [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance destroyed successfully.
Nov 28 18:55:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG nova.network.neutron [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updated VIF entry in instance network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG nova.network.neutron [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:55:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3c303106-9f35-4142-997c-3777338471de req-7ac71ad4-0a72-4a4a-a1e9-158ee54ac01a service nova] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:39 user nova-compute[75203]: WARNING nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:39 user nova-compute[75203]: WARNING nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:39 user nova-compute[75203]: WARNING nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:39 user nova-compute[75203]: WARNING nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:39 user nova-compute[75203]: WARNING nova.compute.manager [req-b5bb52c4-df00-441a-b1ea-a871b5dff504 req-a01226fd-4085-4b39-a1b5-58dcebdf8e5c service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing instance network info cache due to event network-changed-b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] Acquiring lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] Acquired lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Refreshing network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:40 user nova-compute[75203]: DEBUG nova.network.neutron [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updated VIF entry in instance network info cache for port b48b28f4-803d-4ec6-9acd-53b1f4c11568. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:55:40 user nova-compute[75203]: DEBUG nova.network.neutron [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [{"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:55:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fb944508-40d8-4b09-8c84-2ccd4be75b67 req-991a2c5c-4c8a-47da-8b43-6bb2af1985d6 service nova] Releasing lock "refresh_cache-2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-8cbbace5-c9de-4d5f-bd3a-4f28d5394bb0 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:41 user nova-compute[75203]: WARNING nova.compute.manager [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state active and task_state None.
Nov 28 18:55:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:41 user nova-compute[75203]: WARNING nova.compute.manager [req-27430300-63f6-4bcc-91b6-89ea3a03b63f req-8097d51a-6525-4eed-8466-205993008d3e service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state active and task_state None.
Nov 28 18:55:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 18:55:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 18:55:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:48 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 is timed out.
Nov 28 18:55:48 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully detached device vdb from instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 from the live domain config.
Nov 28 18:55:48 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:55:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTCJXHQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:55:48 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:55:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:55:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:55:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d2dd2c-a008-45a3-83ff-1f10db02f941]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:55:49 user nova-compute[75203]: No targets found.
Nov 28 18:55:49 user nova-compute[75203]: iSNS:
Nov 28 18:55:49 user nova-compute[75203]: No targets found.
Nov 28 18:55:49 user nova-compute[75203]: STATIC:
Nov 28 18:55:49 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b
Nov 28 18:55:49 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:55:49 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:55:49 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b
Nov 28 18:55:49 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:55:49 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:55:49 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:55:49 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:55:49 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:55:49 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:55:49 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:55:49 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:55:49 user nova-compute[75203]: FIRMWARE:
Nov 28 18:55:49 user nova-compute[75203]: No targets found.
Nov 28 18:55:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:55:49 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:55:49 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d05604e-6394-4bb8-8561-d5f010b91af7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[202be358-d0ec-49a2-94b6-87e49b1d57e2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:49 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:49 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:49 user nova-compute[75203]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)
Nov 28 18:55:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:49 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:49 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:49 user nova-compute[75203]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b (non-flash)
Nov 28 18:55:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f076c7cad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b'): ({'sde'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Removing single pathed devices sde {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a0a3df-32b2-4722-b600-8b06108e7fae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68bfa95-06d1-4aa9-9283-020710a159f4]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Flushing IO for device /dev/sde {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1589db-bab3-4b7f-a340-cc2858fa0a1d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d09090-ae5e-4a34-a4d3-7bcfcbcc6a30]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba46a7fa-591a-44ea-87b0-047476c2f7f6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c37f59-892a-47bf-8b41-f92850894f30]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260]
Nov 28 18:55:49 user nova-compute[75203]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b, portal: 172.16.0.220,3260] successful.
Nov 28 18:55:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f1e080-59a3-4551-8c82-6bc6f810a4ba]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== disconnect_volume: return (293ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:55:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.objects.instance [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'flavor' on Instance uuid 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-795da210-a123-4a67-8800-b4cbe479f350 tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.698s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.546s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:50 user nova-compute[75203]: INFO nova.compute.manager [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Terminating instance
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.compute.manager [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-ac89231e-a1cc-4664-82fa-31674167aa9a req-46e08d37-a9c2-4547-8f28-fc769c186734 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-vif-unplugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ac89231e-a1cc-4664-82fa-31674167aa9a req-46e08d37-a9c2-4547-8f28-fc769c186734 service nova] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ac89231e-a1cc-4664-82fa-31674167aa9a req-46e08d37-a9c2-4547-8f28-fc769c186734 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ac89231e-a1cc-4664-82fa-31674167aa9a req-46e08d37-a9c2-4547-8f28-fc769c186734 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-ac89231e-a1cc-4664-82fa-31674167aa9a req-46e08d37-a9c2-4547-8f28-fc769c186734 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] No waiting events found dispatching network-vif-unplugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.compute.manager [req-ac89231e-a1cc-4664-82fa-31674167aa9a req-46e08d37-a9c2-4547-8f28-fc769c186734 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-vif-unplugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Instance destroyed successfully.
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.objects.instance [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lazy-loading 'resources' on Instance uuid 48b0d74c-5f15-4a92-bc25-20f89c6d56c7 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-960323793',display_name='tempest-VolumesSnapshotTestJSON-instance-960323793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-960323793',id=33,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO089nCD++IF8sGfc893wlcDPk/K/Lbi0kjUkiyk+eYj63yllfpsDPTO07G2mSAbRWImrn44jG8+Upo3CYI8JUAAGWcWapbw4EYiwXQIqakhYTbJsvsRgTcGoY9jRmNlg==',key_name='tempest-keypair-2045904166',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8dc3f94308cd4b99871d9113d6516bfc',ramdisk_id='',reservation_id='r-a22xwyyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-926769811',owner_user_name='tempest-VolumesSnapshotTestJSON-926769811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe8c1bccaa174d4da0865d55770703a2',uuid=48b0d74c-5f15-4a92-bc25-20f89c6d56c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converting VIF {"id": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "address": "fa:16:3e:02:55:7a", "network": {"id": "e013ea6c-b0cc-4689-9ce5-c86745caefcb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1433358642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc3f94308cd4b99871d9113d6516bfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a2aa4e0-83", "ovs_interfaceid": "8a2aa4e0-83a7-4020-b31e-f57b1a32a057", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=8a2aa4e0-83a7-4020-b31e-f57b1a32a057,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2aa4e0-83') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG os_vif [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=8a2aa4e0-83a7-4020-b31e-f57b1a32a057,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2aa4e0-83') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a2aa4e0-83, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f470c9c8-883e-401a-ad95-cfcd5880af29) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:50 user nova-compute[75203]: INFO os_vif [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:7a,bridge_name='br-int',has_traffic_filtering=True,id=8a2aa4e0-83a7-4020-b31e-f57b1a32a057,network=Network(e013ea6c-b0cc-4689-9ce5-c86745caefcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a2aa4e0-83')
Nov 28 18:55:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTCJXHQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:55:50 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:55:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f3f8f5-2191-4e89-835b-9088c0a691d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:55:50 user nova-compute[75203]: No targets found.
Nov 28 18:55:50 user nova-compute[75203]: iSNS:
Nov 28 18:55:50 user nova-compute[75203]: No targets found.
Nov 28 18:55:50 user nova-compute[75203]: STATIC:
Nov 28 18:55:50 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b
Nov 28 18:55:50 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:55:50 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:55:50 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:55:50 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:55:50 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:55:50 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:55:50 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:55:50 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:55:50 user nova-compute[75203]: FIRMWARE:
Nov 28 18:55:50 user nova-compute[75203]: No targets found.
Nov 28 18:55:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:55:50 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:55:50 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46af9cc0-7039-44f1-baff-621375f8332b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:55:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9843787b-10f3-4a21-84d3-44b27331f00e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d200c8b-40fc-4a36-8341-68e1917d0071]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:51 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:51 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:55:51 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:55:51 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:55:51 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790402290>, {}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Disconnecting from: [] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] <== disconnect_volume: return (75ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:55:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Deleting instance files /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7_del
Nov 28 18:55:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Deletion of /opt/stack/data/nova/instances/48b0d74c-5f15-4a92-bc25-20f89c6d56c7_del complete
Nov 28 18:55:51 user nova-compute[75203]: INFO nova.compute.manager [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:55:51 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Took 0.68 seconds to deallocate network for instance.
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:51 user nova-compute[75203]: WARNING nova.volume.cinder [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Attachment 20e5dd51-2326-4aa2-a103-5d1ad7e11e3f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 20e5dd51-2326-4aa2-a103-5d1ad7e11e3f. (HTTP 404) (Request-ID: req-51c94840-ac93-4176-920b-3347a2417f74)
Nov 28 18:55:51 user nova-compute[75203]: INFO nova.compute.manager [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Took 0.03 seconds to detach 1 volumes for instance.
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-74a2858f-8467-4791-b2a9-6c4ec9033d1f req-9a28e304-0cfd-4d97-a732-459ae6e30917 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-vif-deleted-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:52 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Deleted allocations for instance 48b0d74c-5f15-4a92-bc25-20f89c6d56c7
Nov 28 18:55:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-e81a705d-5a00-4778-9ee6-d521a999cb27 req-d6c3469f-f6ac-40d4-9796-783c980df876 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received event network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e81a705d-5a00-4778-9ee6-d521a999cb27 req-d6c3469f-f6ac-40d4-9796-783c980df876 service nova] Acquiring lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e81a705d-5a00-4778-9ee6-d521a999cb27 req-d6c3469f-f6ac-40d4-9796-783c980df876 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e81a705d-5a00-4778-9ee6-d521a999cb27 req-d6c3469f-f6ac-40d4-9796-783c980df876 service nova] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-e81a705d-5a00-4778-9ee6-d521a999cb27 req-d6c3469f-f6ac-40d4-9796-783c980df876 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] No waiting events found dispatching network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:55:52 user nova-compute[75203]: WARNING nova.compute.manager [req-e81a705d-5a00-4778-9ee6-d521a999cb27 req-d6c3469f-f6ac-40d4-9796-783c980df876 service nova] [instance: 48b0d74c-5f15-4a92-bc25-20f89c6d56c7] Received unexpected event network-vif-plugged-8a2aa4e0-83a7-4020-b31e-f57b1a32a057 for instance with vm_state deleted and task_state None.
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-18b9c618-ec79-43ff-af5e-e308e96a9d5a tempest-VolumesSnapshotTestJSON-926769811 tempest-VolumesSnapshotTestJSON-926769811-project-member] Lock "48b0d74c-5f15-4a92-bc25-20f89c6d56c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.406s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:55:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:55:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:55:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:55:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=7978MB free_disk=24.681812286376953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 25169f0a-a8e6-4a00-a373-06607a08d237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2437f09-319a-41c6-8c04-4ed01af3b1ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:55:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:55:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:56:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:56:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:56:00 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:56:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating instance_info_cache with network_info: [{"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:56:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-33b41c79-f029-473d-b6c8-8b3ec206be68" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:56:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:56:02 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 18:56:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received event network-changed-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:56:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Refreshing instance network info cache due to event network-changed-9b714a0d-a38e-48e8-a118-2c76760365ef. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:56:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] Acquiring lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:56:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] Acquired lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:56:08 user nova-compute[75203]: DEBUG nova.network.neutron [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Refreshing network info cache for port 9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:56:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Updated VIF entry in instance network info cache for port 9b714a0d-a38e-48e8-a118-2c76760365ef. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:56:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Updating instance_info_cache with network_info: [{"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:56:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4f84255f-d879-4f6a-b642-0115b1b35200 req-9ab96fb7-4a36-43ff-8131-902bfdf0cbce service nova] Releasing lock "refresh_cache-25169f0a-a8e6-4a00-a373-06607a08d237" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:56:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:09 user nova-compute[75203]: INFO nova.compute.manager [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Detaching volume a6959b76-fc71-47ba-a86a-c918403d0f1b
Nov 28 18:56:09 user nova-compute[75203]: INFO nova.virt.block_device [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Attempting to driver detach volume a6959b76-fc71-47ba-a86a-c918403d0f1b from mountpoint /dev/vdb
Nov 28 18:56:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Attempting to detach device vdb from instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:56:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:56:09 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:09 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:56:09 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:09 user nova-compute[75203]:   <serial>a6959b76-fc71-47ba-a86a-c918403d0f1b</serial>
Nov 28 18:56:09 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:56:09 user nova-compute[75203]: </disk>
Nov 28 18:56:09 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:56:09 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Successfully detached device vdb from instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 from the persistent domain config.
Nov 28 18:56:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:56:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:56:09 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:09 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:56:09 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:09 user nova-compute[75203]:   <serial>a6959b76-fc71-47ba-a86a-c918403d0f1b</serial>
Nov 28 18:56:09 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:56:09 user nova-compute[75203]: </disk>
Nov 28 18:56:09 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:56:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:56:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lazy-loading 'flavor' on Instance uuid 25169f0a-a8e6-4a00-a373-06607a08d237 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:11 user nova-compute[75203]: INFO nova.compute.manager [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Attaching volume 2709d885-b71d-4d7d-9da1-32021ee95c9a to /dev/vdb
Nov 28 18:56:11 user nova-compute[75203]: DEBUG os_brick.utils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b553b0-ce05-4b8c-ab11-d4ab5daac64a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2bf20b-0ddf-48b9-a8ee-8420edf423bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[126e2c2f-660b-4854-bd61-6d14c67829bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[16534d86-1079-4d71-9dd3-9dae406f7c4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:56:11 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:56:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2604d829-ae49-49fb-a75f-b2697cf1deb5]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG os_brick.utils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:11 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Updating existing volume attachment record: cf92f64a-63e3-4ccd-9b55-986fcbe9cd42 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:56:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMFmhpaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:18 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:18 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:18 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f143ee07-084e-41e3-8b97-6d08d6b3a945]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:56:18 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c28041a-fcf5-48a2-bc0e-7bbf8bec37be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a] added
Nov 28 18:56:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e272b7e0-465f-40d3-b7ea-3518507e3745]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e1dfcf-e5ba-48f4-8e8a-371465b95cdb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMFmhpaG {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMFmhpaG" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e408803-a518-4283-acc1-41c6f3037e32]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMFmhpaG'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a326d620-0151-44d4-8939-765882ec5b41]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f0cad5-47b9-4cca-ae81-d59e0327f51d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:18 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:56:18 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:18 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:56:18 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2fe44c-85ab-4c08-b91e-27a2bfaa5588]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260]
Nov 28 18:56:19 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260] successful.
Nov 28 18:56:19 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae4160-a013-439b-bc73-ff5783603bac]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab7f1a5-a598-4188-8104-fc205ea3061d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:19 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:56:19 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:19 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:19 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:19 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:56:19 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:19 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:19 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d847cf7-3be4-4f83-b1ac-ec1d20f56912]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:56:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMFmhpaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23337366138656533', 'path': '/dev/sde'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337366138656533', 'path': '/dev/sde'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lazy-loading 'flavor' on Instance uuid 25169f0a-a8e6-4a00-a373-06607a08d237 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:56:20 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:20 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:56:20 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:20 user nova-compute[75203]:   <serial>2709d885-b71d-4d7d-9da1-32021ee95c9a</serial>
Nov 28 18:56:20 user nova-compute[75203]: </disk>
Nov 28 18:56:20 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-changed-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Refreshing instance network info cache due to event network-changed-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] Acquiring lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] Acquired lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.network.neutron [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Refreshing network info cache for port 6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] No VIF found with MAC fa:16:3e:34:99:22, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.network.neutron [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updated VIF entry in instance network info cache for port 6ff984b0-c437-4506-aa30-6dd7b2f9d3c7. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG nova.network.neutron [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updating instance_info_cache with network_info: [{"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1c941112-3774-4368-9275-7207f68c0b32 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.023s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17f1c8e1-4b68-4f35-9ae8-a889f1fa3352 req-1c63baa6-1823-4cfe-8bbb-c72677c01b70 service nova] Releasing lock "refresh_cache-e2437f09-319a-41c6-8c04-4ed01af3b1ba" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:56:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:22 user nova-compute[75203]: INFO nova.compute.manager [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Detaching volume 2709d885-b71d-4d7d-9da1-32021ee95c9a
Nov 28 18:56:22 user nova-compute[75203]: INFO nova.virt.block_device [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Attempting to driver detach volume 2709d885-b71d-4d7d-9da1-32021ee95c9a from mountpoint /dev/vdb
Nov 28 18:56:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Attempting to detach device vdb from instance 25169f0a-a8e6-4a00-a373-06607a08d237 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:56:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:56:22 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:22 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:56:22 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:22 user nova-compute[75203]:   <serial>2709d885-b71d-4d7d-9da1-32021ee95c9a</serial>
Nov 28 18:56:22 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:56:22 user nova-compute[75203]: </disk>
Nov 28 18:56:22 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:56:22 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Successfully detached device vdb from instance 25169f0a-a8e6-4a00-a373-06607a08d237 from the persistent domain config.
Nov 28 18:56:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25169f0a-a8e6-4a00-a373-06607a08d237 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:56:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:56:22 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:22 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:56:22 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:22 user nova-compute[75203]:   <serial>2709d885-b71d-4d7d-9da1-32021ee95c9a</serial>
Nov 28 18:56:22 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:56:22 user nova-compute[75203]: </disk>
Nov 28 18:56:22 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:56:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25169f0a-a8e6-4a00-a373-06607a08d237 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG nova.objects.instance [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid e2437f09-319a-41c6-8c04-4ed01af3b1ba {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:23 user nova-compute[75203]: INFO nova.compute.manager [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Attaching volume 71a9b95d-561a-4eb1-a571-389a6e32ef69 to /dev/vdb
Nov 28 18:56:23 user nova-compute[75203]: DEBUG os_brick.utils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6501269f-c875-4669-b95a-9d8b2960df65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f0073a-db0a-4b16-bf70-ec7425e7d90a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6697f1e-aaae-416d-9bef-766b4716575e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e58ee4-a5b1-4dac-87fe-3d64a167c8ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:56:23 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:56:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d67865-503e-43fc-88fc-9241ee30f8c9]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG os_brick.utils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updating existing volume attachment record: 0d84be70-3d8b-4924-a20c-f0ced8b0fce8 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:56:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:30 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 is timed out.
Nov 28 18:56:30 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Successfully detached device vdb from instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 from the live domain config.
Nov 28 18:56:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhgVocbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:30 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8425df43-47b3-4ff4-bd08-c4a77d65eabf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:56:30 user nova-compute[75203]: No targets found.
Nov 28 18:56:30 user nova-compute[75203]: iSNS:
Nov 28 18:56:30 user nova-compute[75203]: No targets found.
Nov 28 18:56:30 user nova-compute[75203]: STATIC:
Nov 28 18:56:30 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b
Nov 28 18:56:30 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:30 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:30 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a
Nov 28 18:56:30 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:30 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:30 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:56:30 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:30 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:30 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:56:30 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:30 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:30 user nova-compute[75203]: FIRMWARE:
Nov 28 18:56:30 user nova-compute[75203]: No targets found.
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:56:30 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:56:30 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99b2cbc-d947-4fd2-b45a-dec87427dc70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c9f5d-4952-4605-b26c-56ada0e635b0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a0337910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dfa1ae-b8ae-4cd6-8503-56c297535689]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c6a3c6-b11c-4f77-9c4c-34d63ee2f868]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f48a71-6192-4edd-adf0-52f4ed0dec5f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46c3e9-a7f9-4e86-9556-8ae6267f40b6]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83c11dc-2433-4103-bd32-c2df4c8c10fb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[268af11d-6b76-4905-81a2-9eceb3e38f5d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260]
Nov 28 18:56:30 user nova-compute[75203]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b, portal: 172.16.0.220,3260] successful.
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6959b76-fc71-47ba-a86a-c918403d0f1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7daf1a9-04b1-46de-9bcc-56db816ed079]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] <== disconnect_volume: return (322ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiYeOGcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:30 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:30 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:30 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e626b9-f2ad-448e-b329-ce395646536f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:56:30 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e5edaf-ca1c-44a9-8d79-7f3347adf677]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69] added
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85206d0-1c57-4f13-8aba-759db1e4650b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bea4f9-7ac6-4d58-8516-d0aa7e031d30]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiYeOGcV {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiYeOGcV" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2648342-ca23-4135-9c41-89f4c2bdad7e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wiYeOGcV'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93faf64-d5a9-44b9-90ba-489834afe804]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d15bd9-3f6a-4495-8f86-05c46c091f6d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a02089d-536b-4ad6-bdd8-603af1c64984]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260]
Nov 28 18:56:30 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260] successful.
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a592a-0dec-4cf9-9565-49b967e7361d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e544f3-5c6a-4541-b244-a644c53a8d7c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:30 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:30 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e56cc7-7a09-48b0-af78-b419d5e9303d]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiYeOGcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:56:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:31 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'flavor' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5a36c211-0ed3-4f7f-aa15-fd793c24a4c6 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.777s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:31 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23561666237666332', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561666237666332', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:56:31 user nova-compute[75203]: DEBUG nova.objects.instance [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid e2437f09-319a-41c6-8c04-4ed01af3b1ba {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:56:31 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:31 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:56:31 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:31 user nova-compute[75203]:   <serial>71a9b95d-561a-4eb1-a571-389a6e32ef69</serial>
Nov 28 18:56:31 user nova-compute[75203]: </disk>
Nov 28 18:56:31 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:56:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:56:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:56:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No VIF found with MAC fa:16:3e:a4:f0:70, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:56:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44418f26-7b20-4990-8816-27e8efd2114d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.298s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:33 user nova-compute[75203]: INFO nova.compute.manager [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Detaching volume 71a9b95d-561a-4eb1-a571-389a6e32ef69
Nov 28 18:56:33 user nova-compute[75203]: INFO nova.virt.block_device [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Attempting to driver detach volume 71a9b95d-561a-4eb1-a571-389a6e32ef69 from mountpoint /dev/vdb
Nov 28 18:56:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Attempting to detach device vdb from instance e2437f09-319a-41c6-8c04-4ed01af3b1ba from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 18:56:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:56:33 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:33 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:56:33 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:33 user nova-compute[75203]:   <serial>71a9b95d-561a-4eb1-a571-389a6e32ef69</serial>
Nov 28 18:56:33 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:56:33 user nova-compute[75203]: </disk>
Nov 28 18:56:33 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:56:33 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully detached device vdb from instance e2437f09-319a-41c6-8c04-4ed01af3b1ba from the persistent domain config.
Nov 28 18:56:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2437f09-319a-41c6-8c04-4ed01af3b1ba from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 18:56:33 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 18:56:33 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:33 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 18:56:33 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:33 user nova-compute[75203]:   <serial>71a9b95d-561a-4eb1-a571-389a6e32ef69</serial>
Nov 28 18:56:33 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 18:56:33 user nova-compute[75203]: </disk>
Nov 28 18:56:33 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 18:56:34 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2437f09-319a-41c6-8c04-4ed01af3b1ba {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 18:56:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-changed-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Refreshing instance network info cache due to event network-changed-a9646837-d0bd-408a-9b59-b36ee39c6ab2. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Refreshing network info cache for port a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:56:42 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25169f0a-a8e6-4a00-a373-06607a08d237 is timed out.
Nov 28 18:56:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Successfully detached device vdb from instance 25169f0a-a8e6-4a00-a373-06607a08d237 from the live domain config.
Nov 28 18:56:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMFmhpaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:42 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[da585731-b0d2-4850-8cee-7f9066eaf428]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:56:42 user nova-compute[75203]: No targets found.
Nov 28 18:56:42 user nova-compute[75203]: iSNS:
Nov 28 18:56:42 user nova-compute[75203]: No targets found.
Nov 28 18:56:42 user nova-compute[75203]: STATIC:
Nov 28 18:56:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a
Nov 28 18:56:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:56:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:56:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69
Nov 28 18:56:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:42 user nova-compute[75203]: FIRMWARE:
Nov 28 18:56:42 user nova-compute[75203]: No targets found.
Nov 28 18:56:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:56:42 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:56:42 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[409a8548-316e-4755-8487-76090b017653]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e80a5b1-a248-4365-a5b1-cb7433f0cf2b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:42 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:42 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:42 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:42 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:42 user nova-compute[75203]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a (non-flash)
Nov 28 18:56:42 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790101ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a'): ({'sde'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Removing single pathed devices sde {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce3082-d40f-4f45-8004-7eb1900cf7cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updated VIF entry in instance network info cache for port a9646837-d0bd-408a-9b59-b36ee39c6ab2. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a10b04-509b-471f-aa0d-5828968ac8c8]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Flushing IO for device /dev/sde {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-20cdc821-cf6a-4cfe-b180-d9efebea4b2f req-e93bc31f-70d8-43ef-8a50-93bd33503ba3 service nova] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a052a-cfb2-4cb4-a0b1-7648f95aba62]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:56:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb2f6f5-e1fe-4f9a-996c-ba2ad20176e7]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a85799-0d23-45df-9c3d-052b6a2707e3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[167910d0-085d-454f-b7db-de9dd4263e2d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260]
Nov 28 18:56:43 user nova-compute[75203]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a, portal: 172.16.0.220,3260] successful.
Nov 28 18:56:43 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2709d885-b71d-4d7d-9da1-32021ee95c9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aaf099-bc07-456d-9100-8a50518e5dee]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] <== disconnect_volume: return (312ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lazy-loading 'flavor' on Instance uuid 25169f0a-a8e6-4a00-a373-06607a08d237 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ae1c825a-5ee6-4888-91ea-67e8f1db5200 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.915s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG nova.objects.instance [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:45 user nova-compute[75203]: INFO nova.compute.manager [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Attaching volume a2ee3427-c105-49ed-815a-18e7fc61e62f to /dev/vdb
Nov 28 18:56:45 user nova-compute[75203]: DEBUG os_brick.utils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf32dd3-2c1e-4cad-8f62-34e436ef5f36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae14d8-1b02-4056-987f-e9a37e06f3da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[452d0ea0-27c5-4ad4-87a4-7e9a8428451d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba6310-e226-43fc-8092-75be86b3d97a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 18:56:45 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 18:56:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[56630ceb-79ea-4a3c-966a-baa98fe98e22]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG os_brick.utils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating existing volume attachment record: e1a18266-7dc7-4bec-9726-410a287a1185 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 18:56:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpjgyThw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:52 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:52 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:52 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5b68a0-a4f2-4333-b41b-dbcd722f6935]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:56:52 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ccabe0-8cfc-433f-805b-f5fc6c82167b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f] added
Nov 28 18:56:52 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4941d7-7efc-4398-b831-4ea0a5fe726d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:52 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b4346-ace1-4b0d-9f27-cf011dff9e1b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpjgyThw {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpjgyThw" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c5b630-9f31-4e9c-b3bd-1a4f35097b1b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpjgyThw'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8c715-0dec-4e1a-be2c-9123f1a8146e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5b4b3-9fcf-4eaf-b4f8-f1f1450b6c02]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[473856d6-ba2c-47e7-b20e-74b7beb815bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]
Nov 28 18:56:53 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.
Nov 28 18:56:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a73222-c5c2-4049-b782-368f7c357236]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a33c5-3d8d-47f2-b421-ef57b6035b44]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:56:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:53 user nova-compute[75203]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:56:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[44421dd1-d76e-4e39-8b57-1e420a00339d]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:56:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2437f09-319a-41c6-8c04-4ed01af3b1ba is timed out.
Nov 28 18:56:54 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully detached device vdb from instance e2437f09-319a-41c6-8c04-4ed01af3b1ba from the live domain config.
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiYeOGcV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:56:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpjgyThw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26139393137376561', 'path': '/dev/sde'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139393137376561', 'path': '/dev/sde'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.212s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.objects.instance [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb7b70-27ae-4490-bea0-3d03b00ea0ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:56:54 user nova-compute[75203]: No targets found.
Nov 28 18:56:54 user nova-compute[75203]: iSNS:
Nov 28 18:56:54 user nova-compute[75203]: No targets found.
Nov 28 18:56:54 user nova-compute[75203]: STATIC:
Nov 28 18:56:54 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f
Nov 28 18:56:54 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:54 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:54 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:56:54 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:54 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:54 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:56:54 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:54 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:54 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69
Nov 28 18:56:54 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:56:54 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:56:54 user nova-compute[75203]: FIRMWARE:
Nov 28 18:56:54 user nova-compute[75203]: No targets found.
Nov 28 18:56:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:56:54 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:56:54 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[37344726-97ce-463d-98b7-b0699ec42bf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 18:56:54 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:56:54 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 18:56:54 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 18:56:54 user nova-compute[75203]:   <serial>a2ee3427-c105-49ed-815a-18e7fc61e62f</serial>
Nov 28 18:56:54 user nova-compute[75203]: </disk>
Nov 28 18:56:54 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6de6c52-f0a7-4744-aa5b-06bfcf5661d5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:54 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:54 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:54 user nova-compute[75203]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:56:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:56:54 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:56:54 user nova-compute[75203]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 (non-flash)
Nov 28 18:56:54 user nova-compute[75203]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:56:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f076c7c8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa99367-67ed-4c47-b31d-b841ca30a9de]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d9fb8-f57a-4a1a-bb94-a6a6ace142f5]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b37817-21d3-4d38-8886-e2b29f299fec]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[174a4629-9bd1-406b-b09d-5c60fd6889e6]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7865f45-f118-425e-bdeb-7614458669d9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eeb26b-8cf9-4da7-98ae-cb78faa139b2]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260]
Nov 28 18:56:54 user nova-compute[75203]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69, portal: 172.16.0.220,3260] successful.
Nov 28 18:56:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a9b95d-561a-4eb1-a571-389a6e32ef69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b27198-cb61-405b-b01c-1092a5491ddf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== disconnect_volume: return (559ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No VIF found with MAC fa:16:3e:4f:07:14, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44001c53-3a8e-4122-9c7c-9a16c692d538 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.224s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid e2437f09-319a-41c6-8c04-4ed01af3b1ba {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a086efe1-274a-4eb2-9cd1-db329b7a1c5d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.072s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3404988-808c-4512-8fe3-1fe8da594d23 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3404988-808c-4512-8fe3-1fe8da594d23 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-a3404988-808c-4512-8fe3-1fe8da594d23 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-a3404988-808c-4512-8fe3-1fe8da594d23 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75203) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-a3404988-808c-4512-8fe3-1fe8da594d23 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-9b917893-b0d6-49a8-89d4-36ac0417a759 req-c2047d98-460d-47d2-ad93-5bd6213b26a7 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9b917893-b0d6-49a8-89d4-36ac0417a759 req-c2047d98-460d-47d2-ad93-5bd6213b26a7 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9b917893-b0d6-49a8-89d4-36ac0417a759 req-c2047d98-460d-47d2-ad93-5bd6213b26a7 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9b917893-b0d6-49a8-89d4-36ac0417a759 req-c2047d98-460d-47d2-ad93-5bd6213b26a7 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-9b917893-b0d6-49a8-89d4-36ac0417a759 req-c2047d98-460d-47d2-ad93-5bd6213b26a7 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:56:55 user nova-compute[75203]: WARNING nova.compute.manager [req-9b917893-b0d6-49a8-89d4-36ac0417a759 req-c2047d98-460d-47d2-ad93-5bd6213b26a7 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state active and task_state powering-off.
Nov 28 18:56:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance destroyed successfully.
Nov 28 18:56:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-a3404988-808c-4512-8fe3-1fe8da594d23 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a3404988-808c-4512-8fe3-1fe8da594d23 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.935s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:56:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:56:57 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:56:57 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8048MB free_disk=24.677932739257812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 25169f0a-a8e6-4a00-a373-06607a08d237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2437f09-319a-41c6-8c04-4ed01af3b1ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:56:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-b4894d35-5f8b-4a99-b1e0-3c5e06854853 req-853dc803-041c-4ca9-b328-aaa25f8f4dd6 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b4894d35-5f8b-4a99-b1e0-3c5e06854853 req-853dc803-041c-4ca9-b328-aaa25f8f4dd6 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b4894d35-5f8b-4a99-b1e0-3c5e06854853 req-853dc803-041c-4ca9-b328-aaa25f8f4dd6 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b4894d35-5f8b-4a99-b1e0-3c5e06854853 req-853dc803-041c-4ca9-b328-aaa25f8f4dd6 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-b4894d35-5f8b-4a99-b1e0-3c5e06854853 req-853dc803-041c-4ca9-b328-aaa25f8f4dd6 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:56:58 user nova-compute[75203]: WARNING nova.compute.manager [req-b4894d35-5f8b-4a99-b1e0-3c5e06854853 req-853dc803-041c-4ca9-b328-aaa25f8f4dd6 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state stopped and task_state None.
Nov 28 18:56:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:56:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:56:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:00 user nova-compute[75203]: INFO nova.compute.manager [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Terminating instance
Nov 28 18:57:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-eb054305-4201-4b27-834c-7272f6e672d5 req-edd68fcc-210f-4cf3-b444-c67eeb72f3c1 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-eb054305-4201-4b27-834c-7272f6e672d5 req-edd68fcc-210f-4cf3-b444-c67eeb72f3c1 service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-eb054305-4201-4b27-834c-7272f6e672d5 req-edd68fcc-210f-4cf3-b444-c67eeb72f3c1 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-eb054305-4201-4b27-834c-7272f6e672d5 req-edd68fcc-210f-4cf3-b444-c67eeb72f3c1 service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-eb054305-4201-4b27-834c-7272f6e672d5 req-edd68fcc-210f-4cf3-b444-c67eeb72f3c1 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-eb054305-4201-4b27-834c-7272f6e672d5 req-edd68fcc-210f-4cf3-b444-c67eeb72f3c1 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-unplugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:01 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Instance destroyed successfully.
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.objects.instance [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lazy-loading 'resources' on Instance uuid 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-216485763',display_name='tempest-ServerStableDeviceRescueTest-server-216485763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-216485763',id=29,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjBUTde2IUZlcPjPkqpXPTcC7hMwTKmf94yvJIrIK8uKKAS2lss5668VzKj/wB72dIaaLGe8rlmmbo8x90E2y6UipdIw8Ly7yjNOtIju+jcy0xA9ygkZvM3Y+jWjHIidQ==',key_name='tempest-keypair-696441057',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e9091039cac4e20b440f4852ad7f293',ramdisk_id='',reservation_id='r-oojliyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1663211552',owner_user_name='tempest-ServerStableDeviceRescueTest-1663211552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='caa3702219cd4ca48fd9754cf1037f24',uuid=2dcad16f-a0dd-4d8d-829e-16e9e6093cf4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converting VIF {"id": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "address": "fa:16:3e:af:ed:f9", "network": {"id": "b6a28cec-3732-472f-a4fb-4ca5a66dede4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1617447799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e9091039cac4e20b440f4852ad7f293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b28f4-80", "ovs_interfaceid": "b48b28f4-803d-4ec6-9acd-53b1f4c11568", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG os_vif [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb48b28f4-80, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dff6d6dc-5cd6-4dd3-9b6a-55f8a8f0c8f4) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:01 user nova-compute[75203]: INFO os_vif [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=b48b28f4-803d-4ec6-9acd-53b1f4c11568,network=Network(b6a28cec-3732-472f-a4fb-4ca5a66dede4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b28f4-80')
Nov 28 18:57:01 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Deleting instance files /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4_del
Nov 28 18:57:01 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Deletion of /opt/stack/data/nova/instances/2dcad16f-a0dd-4d8d-829e-16e9e6093cf4_del complete
Nov 28 18:57:01 user nova-compute[75203]: INFO nova.compute.manager [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 28 18:57:01 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Skipping network cache update for instance because it is being deleted. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:57:01 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Took 0.67 seconds to deallocate network for instance.
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-fc6f06e4-f6e2-4e7a-a5b0-857848c42068 req-20b69bf3-ce34-4e2e-a33a-9fa78d4e0c01 service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-deleted-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:02 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Deleted allocations for instance 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4
Nov 28 18:57:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c420f633-3037-4917-8e89-b5a1956eab16 tempest-ServerStableDeviceRescueTest-1663211552 tempest-ServerStableDeviceRescueTest-1663211552-project-member] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Updating instance_info_cache with network_info: [{"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-e2b743b9-0ec7-43a6-a18b-c72621c2cf60" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-44128dff-1a92-4398-b5c7-73f608a01df8 req-3b35dabf-98ef-4490-b0d7-288fe203633d service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-44128dff-1a92-4398-b5c7-73f608a01df8 req-3b35dabf-98ef-4490-b0d7-288fe203633d service nova] Acquiring lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-44128dff-1a92-4398-b5c7-73f608a01df8 req-3b35dabf-98ef-4490-b0d7-288fe203633d service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-44128dff-1a92-4398-b5c7-73f608a01df8 req-3b35dabf-98ef-4490-b0d7-288fe203633d service nova] Lock "2dcad16f-a0dd-4d8d-829e-16e9e6093cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-44128dff-1a92-4398-b5c7-73f608a01df8 req-3b35dabf-98ef-4490-b0d7-288fe203633d service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] No waiting events found dispatching network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:02 user nova-compute[75203]: WARNING nova.compute.manager [req-44128dff-1a92-4398-b5c7-73f608a01df8 req-3b35dabf-98ef-4490-b0d7-288fe203633d service nova] [instance: 2dcad16f-a0dd-4d8d-829e-16e9e6093cf4] Received unexpected event network-vif-plugged-b48b28f4-803d-4ec6-9acd-53b1f4c11568 for instance with vm_state deleted and task_state None.
Nov 28 18:57:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:57:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 18:57:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:57:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 18:57:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:13 user nova-compute[75203]: INFO nova.compute.manager [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Unrescuing
Nov 28 18:57:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:57:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquired lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:57:13 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating instance_info_cache with network_info: [{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Releasing lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'flavor' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-d48b98d4-9d09-4037-a2c2-346b41c0d43b req-6f0949cb-56f6-4695-877f-c3bd9ab58981 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d48b98d4-9d09-4037-a2c2-346b41c0d43b req-6f0949cb-56f6-4695-877f-c3bd9ab58981 service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d48b98d4-9d09-4037-a2c2-346b41c0d43b req-6f0949cb-56f6-4695-877f-c3bd9ab58981 service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d48b98d4-9d09-4037-a2c2-346b41c0d43b req-6f0949cb-56f6-4695-877f-c3bd9ab58981 service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-d48b98d4-9d09-4037-a2c2-346b41c0d43b req-6f0949cb-56f6-4695-877f-c3bd9ab58981 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:14 user nova-compute[75203]: WARNING nova.compute.manager [req-d48b98d4-9d09-4037-a2c2-346b41c0d43b req-6f0949cb-56f6-4695-877f-c3bd9ab58981 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:57:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance destroyed successfully.
Nov 28 18:57:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:16 user nova-compute[75203]: WARNING nova.compute.manager [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:57:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:16 user nova-compute[75203]: WARNING nova.compute.manager [req-9f869ce4-8530-46a1-829d-62a6b8593730 req-f5f54079-cd6b-4fb3-8c11-c33f6e18fc2e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state rescued and task_state unrescuing.
Nov 28 18:57:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:17 user nova-compute[75203]: INFO nova.compute.manager [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Terminating instance
Nov 28 18:57:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Instance destroyed successfully.
Nov 28 18:57:17 user nova-compute[75203]: DEBUG nova.objects.instance [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lazy-loading 'resources' on Instance uuid 25169f0a-a8e6-4a00-a373-06607a08d237 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1610387206',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1610387206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1610387',id=35,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOaodbGfF/RG4WNOUNPUgIvoh9Mma2YwUkrY0QxiXIXvTWgRcR+BaMgXAP7JoJ7T6WAE7jFnguG1Y304LYRC2YxKUJOtXk1/X4Bn3LGZbwEQ1smu0Q8GbVsdcR2FKHFFQ==',key_name='tempest-keypair-1535421511',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63f24bc0fa04465794db58c27a0d75f3',ramdisk_id='',reservation_id='r-tvqo0gna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1380192923',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f1489f9bd56496cac71675d6ae84be5',uuid=25169f0a-a8e6-4a00-a373-06607a08d237,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Converting VIF {"id": "9b714a0d-a38e-48e8-a118-2c76760365ef", "address": "fa:16:3e:34:99:22", "network": {"id": "1138145a-b915-42b9-af5f-d852f71b250e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-113757056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63f24bc0fa04465794db58c27a0d75f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b714a0d-a3", "ovs_interfaceid": "9b714a0d-a38e-48e8-a118-2c76760365ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:99:22,bridge_name='br-int',has_traffic_filtering=True,id=9b714a0d-a38e-48e8-a118-2c76760365ef,network=Network(1138145a-b915-42b9-af5f-d852f71b250e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b714a0d-a3') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG os_vif [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:99:22,bridge_name='br-int',has_traffic_filtering=True,id=9b714a0d-a38e-48e8-a118-2c76760365ef,network=Network(1138145a-b915-42b9-af5f-d852f71b250e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b714a0d-a3') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b714a0d-a3, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d205c47b-7254-461b-8154-37fde8ce59c6) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:17 user nova-compute[75203]: INFO os_vif [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:99:22,bridge_name='br-int',has_traffic_filtering=True,id=9b714a0d-a38e-48e8-a118-2c76760365ef,network=Network(1138145a-b915-42b9-af5f-d852f71b250e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b714a0d-a3')
Nov 28 18:57:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Deleting instance files /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237_del
Nov 28 18:57:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Deletion of /opt/stack/data/nova/instances/25169f0a-a8e6-4a00-a373-06607a08d237_del complete
Nov 28 18:57:17 user nova-compute[75203]: INFO nova.compute.manager [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 18:57:17 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:57:17 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6fa15c3a-875a-4170-ab6a-74c235910d9c tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:57:18 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Took 0.69 seconds to deallocate network for instance.
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-3247af1a-b684-4532-ba42-c6cf157c0600 req-1a0cc4e4-981c-4fab-b2b9-3735df3f0f77 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received event network-vif-deleted-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:18 user nova-compute[75203]: WARNING nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state active and task_state None.
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received event network-vif-unplugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] No waiting events found dispatching network-vif-unplugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:18 user nova-compute[75203]: WARNING nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received unexpected event network-vif-unplugged-9b714a0d-a38e-48e8-a118-2c76760365ef for instance with vm_state deleted and task_state None.
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received event network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Acquiring lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] Lock "25169f0a-a8e6-4a00-a373-06607a08d237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] No waiting events found dispatching network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:18 user nova-compute[75203]: WARNING nova.compute.manager [req-03039d37-af24-4f32-a9f5-49155c8286da req-b9439dcb-6b68-4fbc-9f85-08228d573820 service nova] [instance: 25169f0a-a8e6-4a00-a373-06607a08d237] Received unexpected event network-vif-plugged-9b714a0d-a38e-48e8-a118-2c76760365ef for instance with vm_state deleted and task_state None.
Nov 28 18:57:18 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:57:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:57:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:19 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Deleted allocations for instance 25169f0a-a8e6-4a00-a373-06607a08d237
Nov 28 18:57:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-c4f143af-9e55-41fd-8a66-1c653525271b tempest-TestServerVolumeAttachScenarioOldVersion-1380192923 tempest-TestServerVolumeAttachScenarioOldVersion-1380192923-project-member] Lock "25169f0a-a8e6-4a00-a373-06607a08d237" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:23 user nova-compute[75203]: INFO nova.compute.manager [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Terminating instance
Nov 28 18:57:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-6814658e-4ff6-480e-928e-9f1b97425609 req-27a7ba9e-230d-48a9-a13e-219d29145da1 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-vif-unplugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6814658e-4ff6-480e-928e-9f1b97425609 req-27a7ba9e-230d-48a9-a13e-219d29145da1 service nova] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6814658e-4ff6-480e-928e-9f1b97425609 req-27a7ba9e-230d-48a9-a13e-219d29145da1 service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6814658e-4ff6-480e-928e-9f1b97425609 req-27a7ba9e-230d-48a9-a13e-219d29145da1 service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-6814658e-4ff6-480e-928e-9f1b97425609 req-27a7ba9e-230d-48a9-a13e-219d29145da1 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] No waiting events found dispatching network-vif-unplugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-6814658e-4ff6-480e-928e-9f1b97425609 req-27a7ba9e-230d-48a9-a13e-219d29145da1 service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-vif-unplugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:57:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Instance destroyed successfully.
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.objects.instance [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'resources' on Instance uuid e2437f09-319a-41c6-8c04-4ed01af3b1ba {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-748511180',display_name='tempest-AttachVolumeNegativeTest-server-748511180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-748511180',id=36,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPWeR5bg1gxLrPEzHUVcs1NSvl7LnY9rcLZIeYj6lvqmOnbdKgH6WsY1BqBpCWXckjtdf8tmmOcT7XKoRhKBOjoHG07YwWM3rwMOSvI+3MxgFfTz80yk6pJ3vfRcUAC3w==',key_name='tempest-keypair-2078354765',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-qcnfi106',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=e2437f09-319a-41c6-8c04-4ed01af3b1ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "address": "fa:16:3e:a4:f0:70", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ff984b0-c4", "ovs_interfaceid": "6ff984b0-c437-4506-aa30-6dd7b2f9d3c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:f0:70,bridge_name='br-int',has_traffic_filtering=True,id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff984b0-c4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG os_vif [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:f0:70,bridge_name='br-int',has_traffic_filtering=True,id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff984b0-c4') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ff984b0-c4, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dee768fc-a6e6-4658-9da0-ddd8144a2c6c) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:24 user nova-compute[75203]: INFO os_vif [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:f0:70,bridge_name='br-int',has_traffic_filtering=True,id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ff984b0-c4')
Nov 28 18:57:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Deleting instance files /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba_del
Nov 28 18:57:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Deletion of /opt/stack/data/nova/instances/e2437f09-319a-41c6-8c04-4ed01af3b1ba_del complete
Nov 28 18:57:24 user nova-compute[75203]: INFO nova.compute.manager [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 28 18:57:24 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:57:24 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:57:25 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:57:25 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Took 0.69 seconds to deallocate network for instance.
Nov 28 18:57:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-cbea8582-0efc-451a-a625-76c4cc68bfd6 req-e672fc3d-a6fb-4114-a70c-6e0e5bdfa7aa service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-vif-deleted-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:25 user nova-compute[75203]: INFO nova.compute.manager [req-cbea8582-0efc-451a-a625-76c4cc68bfd6 req-e672fc3d-a6fb-4114-a70c-6e0e5bdfa7aa service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Neutron deleted interface 6ff984b0-c437-4506-aa30-6dd7b2f9d3c7; detaching it from the instance and deleting it from the info cache
Nov 28 18:57:25 user nova-compute[75203]: DEBUG nova.network.neutron [req-cbea8582-0efc-451a-a625-76c4cc68bfd6 req-e672fc3d-a6fb-4114-a70c-6e0e5bdfa7aa service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:57:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-cbea8582-0efc-451a-a625-76c4cc68bfd6 req-e672fc3d-a6fb-4114-a70c-6e0e5bdfa7aa service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Detach interface failed, port_id=6ff984b0-c437-4506-aa30-6dd7b2f9d3c7, reason: Instance e2437f09-319a-41c6-8c04-4ed01af3b1ba could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:57:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:25 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:57:25 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:57:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:25 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Deleted allocations for instance e2437f09-319a-41c6-8c04-4ed01af3b1ba
Nov 28 18:57:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dd79dea6-aa49-40e1-8d43-f7f710dec9bb tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-7be7a00f-91ce-49ca-9614-31b060b289e8 req-e0faa208-e562-4542-9ac0-8282454dafbf service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received event network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:57:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7be7a00f-91ce-49ca-9614-31b060b289e8 req-e0faa208-e562-4542-9ac0-8282454dafbf service nova] Acquiring lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7be7a00f-91ce-49ca-9614-31b060b289e8 req-e0faa208-e562-4542-9ac0-8282454dafbf service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7be7a00f-91ce-49ca-9614-31b060b289e8 req-e0faa208-e562-4542-9ac0-8282454dafbf service nova] Lock "e2437f09-319a-41c6-8c04-4ed01af3b1ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-7be7a00f-91ce-49ca-9614-31b060b289e8 req-e0faa208-e562-4542-9ac0-8282454dafbf service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] No waiting events found dispatching network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:57:26 user nova-compute[75203]: WARNING nova.compute.manager [req-7be7a00f-91ce-49ca-9614-31b060b289e8 req-e0faa208-e562-4542-9ac0-8282454dafbf service nova] [instance: e2437f09-319a-41c6-8c04-4ed01af3b1ba] Received unexpected event network-vif-plugged-6ff984b0-c437-4506-aa30-6dd7b2f9d3c7 for instance with vm_state deleted and task_state None.
Nov 28 18:57:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:53 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:53 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:57:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:57:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:57:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:57:55 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8586MB free_disk=24.84946060180664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:57:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:57:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:57:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:57:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:57:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:03 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:58:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:58:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:58:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:58:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:58:04 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating instance_info_cache with network_info: [{"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:58:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-43144e1b-45b4-4d5e-b81b-4246a96f3c1d" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:58:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:58:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:58:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:18 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:58:18 user nova-compute[75203]: INFO nova.compute.claims [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Claim successful on node user
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:58:19 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.policy [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e0355eaade04b2b9d377a6b2c78585e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40e597eb0284510980106d2de8c235b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:58:19 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Creating image(s)
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "/opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "/opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.246s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk 1073741824" returned: 0 in 0.063s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:19 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Successfully created port: 368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.216s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Cannot resize image /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Ensure instance console log exists: /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Successfully updated port: 368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquired lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-changed-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Refreshing instance network info cache due to event network-changed-368b563c-1b4e-4a21-9e90-45fc8a757cb3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] Acquiring lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updating instance_info_cache with network_info: [{"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Releasing lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Instance network_info: |[{"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] Acquired lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.neutron [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Refreshing network info cache for port 368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Start _get_guest_xml network_info=[{"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:58:21 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:58:21 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1710164239',display_name='tempest-AttachVolumeNegativeTest-server-1710164239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1710164239',id=38,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhmIOR7MynFlObSZAZBcGnJSvTw+GlSxWUfO8pL+m6YtlMLyivdWmsbpThKcTTnfRNIpjQXvvZweZk1Csn9Z5SQL2lmYT3B05lT99cr/5rMo5OOzzOoiowt5q420ecKXA==',key_name='tempest-keypair-1504387575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-2s4gkoox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=efe7cbf2-3fc0-4a69-95ba-368141bb8f99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:c4,bridge_name='br-int',has_traffic_filtering=True,id=368b563c-1b4e-4a21-9e90-45fc8a757cb3,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b563c-1b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.objects.instance [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'pci_devices' on Instance uuid efe7cbf2-3fc0-4a69-95ba-368141bb8f99 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:58:21 user nova-compute[75203]:   <uuid>efe7cbf2-3fc0-4a69-95ba-368141bb8f99</uuid>
Nov 28 18:58:21 user nova-compute[75203]:   <name>instance-00000026</name>
Nov 28 18:58:21 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:58:21 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:58:21 user nova-compute[75203]:   <metadata>
Nov 28 18:58:21 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:58:21 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:58:21 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1710164239</nova:name>
Nov 28 18:58:21 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:58:21</nova:creationTime>
Nov 28 18:58:21 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:58:21 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:58:21 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:58:21 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:58:21 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:58:21 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:58:21 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:58:21 user nova-compute[75203]:       <nova:owner>
Nov 28 18:58:21 user nova-compute[75203]:         <nova:user uuid="7e0355eaade04b2b9d377a6b2c78585e">tempest-AttachVolumeNegativeTest-977864769-project-member</nova:user>
Nov 28 18:58:21 user nova-compute[75203]:         <nova:project uuid="d40e597eb0284510980106d2de8c235b">tempest-AttachVolumeNegativeTest-977864769</nova:project>
Nov 28 18:58:21 user nova-compute[75203]:       </nova:owner>
Nov 28 18:58:21 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:58:21 user nova-compute[75203]:       <nova:ports>
Nov 28 18:58:21 user nova-compute[75203]:         <nova:port uuid="368b563c-1b4e-4a21-9e90-45fc8a757cb3">
Nov 28 18:58:21 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 28 18:58:21 user nova-compute[75203]:         </nova:port>
Nov 28 18:58:21 user nova-compute[75203]:       </nova:ports>
Nov 28 18:58:21 user nova-compute[75203]:     </nova:instance>
Nov 28 18:58:21 user nova-compute[75203]:   </metadata>
Nov 28 18:58:21 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:58:21 user nova-compute[75203]:     <system>
Nov 28 18:58:21 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:58:21 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:58:21 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:58:21 user nova-compute[75203]:       <entry name="serial">efe7cbf2-3fc0-4a69-95ba-368141bb8f99</entry>
Nov 28 18:58:21 user nova-compute[75203]:       <entry name="uuid">efe7cbf2-3fc0-4a69-95ba-368141bb8f99</entry>
Nov 28 18:58:21 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:58:21 user nova-compute[75203]:     </system>
Nov 28 18:58:21 user nova-compute[75203]:   </sysinfo>
Nov 28 18:58:21 user nova-compute[75203]:   <os>
Nov 28 18:58:21 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:58:21 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:58:21 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:58:21 user nova-compute[75203]:   </os>
Nov 28 18:58:21 user nova-compute[75203]:   <features>
Nov 28 18:58:21 user nova-compute[75203]:     <acpi/>
Nov 28 18:58:21 user nova-compute[75203]:     <apic/>
Nov 28 18:58:21 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:58:21 user nova-compute[75203]:   </features>
Nov 28 18:58:21 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:58:21 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:58:21 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:58:21 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:58:21 user nova-compute[75203]:   </clock>
Nov 28 18:58:21 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:58:21 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:58:21 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:58:21 user nova-compute[75203]:   </cpu>
Nov 28 18:58:21 user nova-compute[75203]:   <devices>
Nov 28 18:58:21 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:58:21 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:58:21 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk"/>
Nov 28 18:58:21 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:58:21 user nova-compute[75203]:     </disk>
Nov 28 18:58:21 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:58:21 user nova-compute[75203]:       <mac address="fa:16:3e:4b:cb:c4"/>
Nov 28 18:58:21 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:58:21 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:58:21 user nova-compute[75203]:       <target dev="tap368b563c-1b"/>
Nov 28 18:58:21 user nova-compute[75203]:     </interface>
Nov 28 18:58:21 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:58:21 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/console.log" append="off"/>
Nov 28 18:58:21 user nova-compute[75203]:     </serial>
Nov 28 18:58:21 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:58:21 user nova-compute[75203]:     <video>
Nov 28 18:58:21 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:58:21 user nova-compute[75203]:     </video>
Nov 28 18:58:21 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:58:21 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:58:21 user nova-compute[75203]:     </rng>
Nov 28 18:58:21 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:58:21 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:58:21 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:58:21 user nova-compute[75203]:     </memballoon>
Nov 28 18:58:21 user nova-compute[75203]:   </devices>
Nov 28 18:58:21 user nova-compute[75203]: </domain>
Nov 28 18:58:21 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1710164239',display_name='tempest-AttachVolumeNegativeTest-server-1710164239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1710164239',id=38,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhmIOR7MynFlObSZAZBcGnJSvTw+GlSxWUfO8pL+m6YtlMLyivdWmsbpThKcTTnfRNIpjQXvvZweZk1Csn9Z5SQL2lmYT3B05lT99cr/5rMo5OOzzOoiowt5q420ecKXA==',key_name='tempest-keypair-1504387575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-2s4gkoox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=efe7cbf2-3fc0-4a69-95ba-368141bb8f99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:c4,bridge_name='br-int',has_traffic_filtering=True,id=368b563c-1b4e-4a21-9e90-45fc8a757cb3,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b563c-1b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG os_vif [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:c4,bridge_name='br-int',has_traffic_filtering=True,id=368b563c-1b4e-4a21-9e90-45fc8a757cb3,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b563c-1b') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da72bfd6-ea64-58fc-ad89-43ad2b2196bb', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap368b563c-1b, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap368b563c-1b, col_values=(('qos', UUID('1f8fc2b3-75f8-4b6a-ab8f-9ffb6c10b5d9')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap368b563c-1b, col_values=(('external_ids', {'iface-id': '368b563c-1b4e-4a21-9e90-45fc8a757cb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:cb:c4', 'vm-uuid': 'efe7cbf2-3fc0-4a69-95ba-368141bb8f99'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:21 user nova-compute[75203]: INFO os_vif [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:c4,bridge_name='br-int',has_traffic_filtering=True,id=368b563c-1b4e-4a21-9e90-45fc8a757cb3,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b563c-1b')
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:58:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No VIF found with MAC fa:16:3e:4b:cb:c4, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:58:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updated VIF entry in instance network info cache for port 368b563c-1b4e-4a21-9e90-45fc8a757cb3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:58:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updating instance_info_cache with network_info: [{"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:58:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-af413840-d53d-40e6-86c9-e5af5ffecdbd req-e67ab846-63d2-4a68-baad-0020a6d60211 service nova] Releasing lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-2ca6ea1d-a82f-4d4c-b0fb-606238c0f843 req-b1206a0e-9def-4fe1-9439-5041a5eedb60 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2ca6ea1d-a82f-4d4c-b0fb-606238c0f843 req-b1206a0e-9def-4fe1-9439-5041a5eedb60 service nova] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2ca6ea1d-a82f-4d4c-b0fb-606238c0f843 req-b1206a0e-9def-4fe1-9439-5041a5eedb60 service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2ca6ea1d-a82f-4d4c-b0fb-606238c0f843 req-b1206a0e-9def-4fe1-9439-5041a5eedb60 service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-2ca6ea1d-a82f-4d4c-b0fb-606238c0f843 req-b1206a0e-9def-4fe1-9439-5041a5eedb60 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] No waiting events found dispatching network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:58:23 user nova-compute[75203]: WARNING nova.compute.manager [req-2ca6ea1d-a82f-4d4c-b0fb-606238c0f843 req-b1206a0e-9def-4fe1-9439-5041a5eedb60 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received unexpected event network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 for instance with vm_state building and task_state spawning.
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:58:25 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Instance spawned successfully.
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-997fb32f-aefa-4e2c-9376-7348b7725f9e req-df60c864-af4f-46ee-a7ad-6728193b8281 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-997fb32f-aefa-4e2c-9376-7348b7725f9e req-df60c864-af4f-46ee-a7ad-6728193b8281 service nova] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-997fb32f-aefa-4e2c-9376-7348b7725f9e req-df60c864-af4f-46ee-a7ad-6728193b8281 service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-997fb32f-aefa-4e2c-9376-7348b7725f9e req-df60c864-af4f-46ee-a7ad-6728193b8281 service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-997fb32f-aefa-4e2c-9376-7348b7725f9e req-df60c864-af4f-46ee-a7ad-6728193b8281 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] No waiting events found dispatching network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:58:25 user nova-compute[75203]: WARNING nova.compute.manager [req-997fb32f-aefa-4e2c-9376-7348b7725f9e req-df60c864-af4f-46ee-a7ad-6728193b8281 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received unexpected event network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 for instance with vm_state building and task_state spawning.
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:58:25 user nova-compute[75203]: INFO nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 28 18:58:25 user nova-compute[75203]: DEBUG nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:58:25 user nova-compute[75203]: INFO nova.compute.manager [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Took 7.09 seconds to build instance.
Nov 28 18:58:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44ae4e73-d0ce-4558-9422-99f12ccee939 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.270s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:58:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:46 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:58:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:58:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:58:46 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'info_cache' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:46 user nova-compute[75203]: DEBUG nova.objects.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:58:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:58:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance destroyed successfully.
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'resources' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.objects.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_vif [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9646837-d0, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49c3357b-1188-474f-919f-74ad5d585e56) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:47 user nova-compute[75203]: INFO os_vif [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0')
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpjgyThw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:58:47 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b24ef8-0b7b-42db-aaea-64266b50658f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:58:47 user nova-compute[75203]: No targets found.
Nov 28 18:58:47 user nova-compute[75203]: iSNS:
Nov 28 18:58:47 user nova-compute[75203]: No targets found.
Nov 28 18:58:47 user nova-compute[75203]: STATIC:
Nov 28 18:58:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f
Nov 28 18:58:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:58:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:58:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:58:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:58:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:58:47 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:58:47 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:58:47 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:58:47 user nova-compute[75203]: FIRMWARE:
Nov 28 18:58:47 user nova-compute[75203]: No targets found.
Nov 28 18:58:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:58:47 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:58:47 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e9f50-79b7-46c3-ba2b-0647115f94b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055eecd-5aa4-4dfe-9124-0d5872a1856f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:58:47 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:58:47 user nova-compute[75203]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:58:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:58:47 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:58:47 user nova-compute[75203]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:58:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903c32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f'): ({'sde'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Removing single pathed devices sde {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c150aca5-6a5c-4ac4-8aea-6c9ff8a39ac2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[64381b11-44b3-4faa-8fd2-7a95a715936e]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flushing IO for device /dev/sde {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef96a4d-f3d1-4867-a0d8-fd8890072a66]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4618ecd2-91f4-4296-919f-9d8ef542ac1b]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ceff38-6c43-4763-ad05-13c0967fdd7b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f953177-82b1-4403-9f59-9e3492378ed8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]
Nov 28 18:58:47 user nova-compute[75203]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.
Nov 28 18:58:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698ee7e-ab0d-4ce3-9927-e0a62cd2f65e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== disconnect_volume: return (313ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Start _get_guest_xml network_info=[{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpjgyThw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '17161f39-18b4-488b-871d-bc8e9e8faa00', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2ee3427-c105-49ed-815a-18e7fc61e62f', 'serial': 'a2ee3427-c105-49ed-815a-18e7fc61e62f'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'e1a18266-7dc7-4bec-9726-410a287a1185', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'numa_topology' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.objects.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:58:47 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:58:47 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.objects.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpjgyThw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:58:47 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:58:47 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:58:47 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac3d0e0-f2f8-4d8a-968f-27b0d011c0d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 18:58:47 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8885e952-2ed5-4494-92a6-81453f1405f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f] added
Nov 28 18:58:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.146s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32a584-973b-464d-94e1-8bf3c993e4c9]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bf7a1c-14b8-47ce-8e5a-29af10a198e7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpjgyThw {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpjgyThw" returned: 0 in 0.121s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b39c31-d4f7-4f7a-99c3-f121d570d49d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpjgyThw'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.065s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a34a8-5a74-41f3-bed7-2ee4032c934f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f162c-2567-43c2-b648-87a9cc02e8a1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:58:47 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:58:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:58:47 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:58:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:58:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[363aeeff-f8a3-441b-ae55-7e3cf21a7340]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]
Nov 28 18:58:48 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.
Nov 28 18:58:48 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e29754-2ce9-4b34-8c1e-f5216328216d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[758991c1-7781-4f39-b829-2e7b6422165e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:58:48 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:58:48 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:58:48 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:58:48 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:58:48 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:58:48 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.591s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f064113-a158-4900-be48-65e8f2ac7eb1]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpjgyThw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 18:58:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.629s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== connect_volume: return (1631ms) {'type': 'block', 'scsi_wwn': '26139393137376561', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139393137376561', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'pci_devices' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.objects.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:58:49 user nova-compute[75203]:   <uuid>17161f39-18b4-488b-871d-bc8e9e8faa00</uuid>
Nov 28 18:58:49 user nova-compute[75203]:   <name>instance-00000025</name>
Nov 28 18:58:49 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:58:49 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:58:49 user nova-compute[75203]:   <metadata>
Nov 28 18:58:49 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:58:49 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:58:49 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeTestJSON-server-1378465901</nova:name>
Nov 28 18:58:49 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:58:47</nova:creationTime>
Nov 28 18:58:49 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:58:49 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:58:49 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:58:49 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:58:49 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:58:49 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:58:49 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:58:49 user nova-compute[75203]:       <nova:owner>
Nov 28 18:58:49 user nova-compute[75203]:         <nova:user uuid="a95b00fbf38d4d9b852837c31a4cca68">tempest-AttachVolumeTestJSON-1450919923-project-member</nova:user>
Nov 28 18:58:49 user nova-compute[75203]:         <nova:project uuid="539e02b4366e46878557f18ea375a24a">tempest-AttachVolumeTestJSON-1450919923</nova:project>
Nov 28 18:58:49 user nova-compute[75203]:       </nova:owner>
Nov 28 18:58:49 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:58:49 user nova-compute[75203]:       <nova:ports>
Nov 28 18:58:49 user nova-compute[75203]:         <nova:port uuid="a9646837-d0bd-408a-9b59-b36ee39c6ab2">
Nov 28 18:58:49 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 18:58:49 user nova-compute[75203]:         </nova:port>
Nov 28 18:58:49 user nova-compute[75203]:       </nova:ports>
Nov 28 18:58:49 user nova-compute[75203]:     </nova:instance>
Nov 28 18:58:49 user nova-compute[75203]:   </metadata>
Nov 28 18:58:49 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:58:49 user nova-compute[75203]:     <system>
Nov 28 18:58:49 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:58:49 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:58:49 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:58:49 user nova-compute[75203]:       <entry name="serial">17161f39-18b4-488b-871d-bc8e9e8faa00</entry>
Nov 28 18:58:49 user nova-compute[75203]:       <entry name="uuid">17161f39-18b4-488b-871d-bc8e9e8faa00</entry>
Nov 28 18:58:49 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:58:49 user nova-compute[75203]:     </system>
Nov 28 18:58:49 user nova-compute[75203]:   </sysinfo>
Nov 28 18:58:49 user nova-compute[75203]:   <os>
Nov 28 18:58:49 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:58:49 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:58:49 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:58:49 user nova-compute[75203]:   </os>
Nov 28 18:58:49 user nova-compute[75203]:   <features>
Nov 28 18:58:49 user nova-compute[75203]:     <acpi/>
Nov 28 18:58:49 user nova-compute[75203]:     <apic/>
Nov 28 18:58:49 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:58:49 user nova-compute[75203]:   </features>
Nov 28 18:58:49 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:58:49 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:58:49 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:58:49 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:58:49 user nova-compute[75203]:   </clock>
Nov 28 18:58:49 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:58:49 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:58:49 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:58:49 user nova-compute[75203]:   </cpu>
Nov 28 18:58:49 user nova-compute[75203]:   <devices>
Nov 28 18:58:49 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:58:49 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:58:49 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk"/>
Nov 28 18:58:49 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:58:49 user nova-compute[75203]:     </disk>
Nov 28 18:58:49 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 18:58:49 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 18:58:49 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 18:58:49 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 18:58:49 user nova-compute[75203]:       <serial>a2ee3427-c105-49ed-815a-18e7fc61e62f</serial>
Nov 28 18:58:49 user nova-compute[75203]:     </disk>
Nov 28 18:58:49 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:58:49 user nova-compute[75203]:       <mac address="fa:16:3e:4f:07:14"/>
Nov 28 18:58:49 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:58:49 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:58:49 user nova-compute[75203]:       <target dev="tapa9646837-d0"/>
Nov 28 18:58:49 user nova-compute[75203]:     </interface>
Nov 28 18:58:49 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:58:49 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/console.log" append="off"/>
Nov 28 18:58:49 user nova-compute[75203]:     </serial>
Nov 28 18:58:49 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:58:49 user nova-compute[75203]:     <video>
Nov 28 18:58:49 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:58:49 user nova-compute[75203]:     </video>
Nov 28 18:58:49 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:58:49 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:58:49 user nova-compute[75203]:     </rng>
Nov 28 18:58:49 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:58:49 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:58:49 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:58:49 user nova-compute[75203]:     </memballoon>
Nov 28 18:58:49 user nova-compute[75203]:   </devices>
Nov 28 18:58:49 user nova-compute[75203]: </domain>
Nov 28 18:58:49 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'trusted_certs' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.objects.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:58:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Cannot resize image /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'migration_context' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG nova.objects.base [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG os_vif [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95e3c0ce-1fa7-5bfc-abe6-2c5bd3c7fe69', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9646837-d0, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9646837-d0, col_values=(('qos', UUID('95303270-803b-43ac-88a7-12a8856818cd')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9646837-d0, col_values=(('external_ids', {'iface-id': 'a9646837-d0bd-408a-9b59-b36ee39c6ab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:07:14', 'vm-uuid': '17161f39-18b4-488b-871d-bc8e9e8faa00'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:58:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:50 user nova-compute[75203]: INFO os_vif [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0')
Nov 28 18:58:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-9ff20295-4870-44cf-ae14-c21da521dc33 req-e8bde848-de6d-42cb-85d0-a6cf2c4393d9 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ff20295-4870-44cf-ae14-c21da521dc33 req-e8bde848-de6d-42cb-85d0-a6cf2c4393d9 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ff20295-4870-44cf-ae14-c21da521dc33 req-e8bde848-de6d-42cb-85d0-a6cf2c4393d9 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ff20295-4870-44cf-ae14-c21da521dc33 req-e8bde848-de6d-42cb-85d0-a6cf2c4393d9 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:51 user nova-compute[75203]: DEBUG nova.compute.manager [req-9ff20295-4870-44cf-ae14-c21da521dc33 req-e8bde848-de6d-42cb-85d0-a6cf2c4393d9 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:58:51 user nova-compute[75203]: WARNING nova.compute.manager [req-9ff20295-4870-44cf-ae14-c21da521dc33 req-e8bde848-de6d-42cb-85d0-a6cf2c4393d9 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state stopped and task_state powering-on.
Nov 28 18:58:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:58:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance rebooted successfully.
Nov 28 18:58:53 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9d22db85-1936-4f68-9ff2-142275a3fb7f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:58:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-3cc24076-8e72-4bc3-b35f-ddf564e936c2 req-e44d8d0f-aa3a-4588-9890-eafea797bd47 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:58:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3cc24076-8e72-4bc3-b35f-ddf564e936c2 req-e44d8d0f-aa3a-4588-9890-eafea797bd47 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3cc24076-8e72-4bc3-b35f-ddf564e936c2 req-e44d8d0f-aa3a-4588-9890-eafea797bd47 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3cc24076-8e72-4bc3-b35f-ddf564e936c2 req-e44d8d0f-aa3a-4588-9890-eafea797bd47 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-3cc24076-8e72-4bc3-b35f-ddf564e936c2 req-e44d8d0f-aa3a-4588-9890-eafea797bd47 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:58:53 user nova-compute[75203]: WARNING nova.compute.manager [req-3cc24076-8e72-4bc3-b35f-ddf564e936c2 req-e44d8d0f-aa3a-4588-9890-eafea797bd47 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state stopped and task_state powering-on.
Nov 28 18:58:54 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:54 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:58:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:58:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:58:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:58:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:58:57 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:58:57 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8422MB free_disk=24.807327270507812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:58:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:58:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:58:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:58:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 18:58:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:04 user nova-compute[75203]: INFO nova.compute.manager [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Terminating instance
Nov 28 18:59:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-47001a44-562a-4b57-84e9-c035d68998ad req-cc535347-1780-474a-ba20-ed342b547e4e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-47001a44-562a-4b57-84e9-c035d68998ad req-cc535347-1780-474a-ba20-ed342b547e4e service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-47001a44-562a-4b57-84e9-c035d68998ad req-cc535347-1780-474a-ba20-ed342b547e4e service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-47001a44-562a-4b57-84e9-c035d68998ad req-cc535347-1780-474a-ba20-ed342b547e4e service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-47001a44-562a-4b57-84e9-c035d68998ad req-cc535347-1780-474a-ba20-ed342b547e4e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:59:04 user nova-compute[75203]: DEBUG nova.compute.manager [req-47001a44-562a-4b57-84e9-c035d68998ad req-cc535347-1780-474a-ba20-ed342b547e4e service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-unplugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Instance destroyed successfully.
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.objects.instance [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'resources' on Instance uuid 43144e1b-45b4-4d5e-b81b-4246a96f3c1d {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:53:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967500111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967500111',id=34,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:55:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-nx6ujcs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:57:19Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=43144e1b-45b4-4d5e-b81b-4246a96f3c1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "address": "fa:16:3e:6e:25:e5", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce60268-40", "ovs_interfaceid": "7ce60268-403d-4ac8-ac63-c01d13e9e3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_vif [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ce60268-40, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cafb1849-44a6-4a53-a721-f1a40d77aa0c) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:05 user nova-compute[75203]: INFO os_vif [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:25:e5,bridge_name='br-int',has_traffic_filtering=True,id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce60268-40')
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKGNabSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 18:59:05 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e74ace-7995-4e54-87cf-47222bf72e3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 18:59:05 user nova-compute[75203]: No targets found.
Nov 28 18:59:05 user nova-compute[75203]: iSNS:
Nov 28 18:59:05 user nova-compute[75203]: No targets found.
Nov 28 18:59:05 user nova-compute[75203]: STATIC:
Nov 28 18:59:05 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f
Nov 28 18:59:05 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:59:05 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:59:05 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822
Nov 28 18:59:05 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:59:05 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:59:05 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 18:59:05 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 18:59:05 user nova-compute[75203]:                 Iface Name: default
Nov 28 18:59:05 user nova-compute[75203]: FIRMWARE:
Nov 28 18:59:05 user nova-compute[75203]: No targets found.
Nov 28 18:59:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 18:59:05 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 18:59:05 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee4d82-527a-4e86-b0f8-d68b5111b671]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2434f0e9-c82c-40c8-b66a-fdf88cf91c47]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:59:05 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:59:05 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:59:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 18:59:05 user nova-compute[75203]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 (non-flash)
Nov 28 18:59:05 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 18:59:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f079018a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822'): ({'sdd'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Removing single pathed devices sdd {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25fca07-8765-4dbd-ad9f-b94a4a347c96]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[61445398-f898-41ab-acfe-4856544a97d2]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flushing IO for device /dev/sdd {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a9645-130f-4d9a-85eb-b60641b0c9a2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbbf1e3-d14b-491d-be99-afdd5bdc822a]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6069c34e-df006191af9baab6', '/dev/disk/by-id/scsi-26466303036313931', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6069c34e') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1336d893-108c-4c6d-b911-e500465ec0ef]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[287eaf46-42c4-4b2b-bfa5-1873c0b7ec3d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[625afa16-2d8c-4d89-b681-5cc64902ef84]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260]
Nov 28 18:59:05 user nova-compute[75203]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822, portal: 172.16.0.220,3260] successful.
Nov 28 18:59:05 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a604db6c-1a43-4dc4-9c8a-8d922675c822 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a2a237-5bbc-4f58-a077-0ff72a393a2d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== disconnect_volume: return (394ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 18:59:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Deleting instance files /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d_del
Nov 28 18:59:05 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Deletion of /opt/stack/data/nova/instances/43144e1b-45b4-4d5e-b81b-4246a96f3c1d_del complete
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 18:59:05 user nova-compute[75203]: INFO nova.compute.manager [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 28 18:59:05 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:59:05 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:59:06 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Took 0.60 seconds to deallocate network for instance.
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-d022bf98-2de4-4957-9c2e-b60936ddeca8 req-8804c9f8-3b1d-4c7b-9212-977d231dd28d service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-deleted-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:06 user nova-compute[75203]: INFO nova.compute.manager [req-d022bf98-2de4-4957-9c2e-b60936ddeca8 req-8804c9f8-3b1d-4c7b-9212-977d231dd28d service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Neutron deleted interface 7ce60268-403d-4ac8-ac63-c01d13e9e3f5; detaching it from the instance and deleting it from the info cache
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-d022bf98-2de4-4957-9c2e-b60936ddeca8 req-8804c9f8-3b1d-4c7b-9212-977d231dd28d service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-d022bf98-2de4-4957-9c2e-b60936ddeca8 req-8804c9f8-3b1d-4c7b-9212-977d231dd28d service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Detach interface failed, port_id=7ce60268-403d-4ac8-ac63-c01d13e9e3f5, reason: Instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5ab4dba-b6c8-40b8-b7a1-bd55d876ba51 req-276fbb98-e3a2-430b-8956-9324b0298fff service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5ab4dba-b6c8-40b8-b7a1-bd55d876ba51 req-276fbb98-e3a2-430b-8956-9324b0298fff service nova] Acquiring lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5ab4dba-b6c8-40b8-b7a1-bd55d876ba51 req-276fbb98-e3a2-430b-8956-9324b0298fff service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5ab4dba-b6c8-40b8-b7a1-bd55d876ba51 req-276fbb98-e3a2-430b-8956-9324b0298fff service nova] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5ab4dba-b6c8-40b8-b7a1-bd55d876ba51 req-276fbb98-e3a2-430b-8956-9324b0298fff service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] No waiting events found dispatching network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:59:06 user nova-compute[75203]: WARNING nova.compute.manager [req-a5ab4dba-b6c8-40b8-b7a1-bd55d876ba51 req-276fbb98-e3a2-430b-8956-9324b0298fff service nova] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Received unexpected event network-vif-plugged-7ce60268-403d-4ac8-ac63-c01d13e9e3f5 for instance with vm_state active and task_state deleting.
Nov 28 18:59:07 user nova-compute[75203]: INFO nova.compute.manager [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 43144e1b-45b4-4d5e-b81b-4246a96f3c1d] Took 0.87 seconds to detach 1 volumes for instance.
Nov 28 18:59:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:07 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:59:07 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:59:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:07 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Deleted allocations for instance 43144e1b-45b4-4d5e-b81b-4246a96f3c1d
Nov 28 18:59:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-094c0ace-d129-45cf-a4a6-cb9a01b51957 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "43144e1b-45b4-4d5e-b81b-4246a96f3c1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.224s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 18:59:22 user nova-compute[75203]: INFO nova.compute.claims [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Claim successful on node user
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 18:59:22 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.policy [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '350de204ebf54cadb8a3c71049b7ff27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca81c62e02c4570b890ea72f07dfe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 18:59:22 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Creating image(s)
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "/opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "/opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk 1073741824" returned: 0 in 0.061s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Successfully created port: ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Cannot resize image /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Ensure instance console log exists: /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Successfully updated port: ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "refresh_cache-ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquired lock "refresh_cache-ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received event network-changed-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Refreshing instance network info cache due to event network-changed-ac27d69f-6cfe-41e8-818e-480062c65389. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 18:59:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] Acquiring lock "refresh_cache-ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Updating instance_info_cache with network_info: [{"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Releasing lock "refresh_cache-ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Instance network_info: |[{"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] Acquired lock "refresh_cache-ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Refreshing network info cache for port ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Start _get_guest_xml network_info=[{"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 18:59:24 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:59:24 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-334219567',display_name='tempest-VolumesActionsTest-instance-334219567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-334219567',id=39,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca81c62e02c4570b890ea72f07dfe1d',ramdisk_id='',reservation_id='r-6wqtr2ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1987920535',owner_user_name='tempest-VolumesActionsTest-1987920535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:59:23Z,user_data=None,user_id='350de204ebf54cadb8a3c71049b7ff27',uuid=ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converting VIF {"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=ac27d69f-6cfe-41e8-818e-480062c65389,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac27d69f-6c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lazy-loading 'pci_devices' on Instance uuid ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 18:59:24 user nova-compute[75203]:   <uuid>ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c</uuid>
Nov 28 18:59:24 user nova-compute[75203]:   <name>instance-00000027</name>
Nov 28 18:59:24 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 18:59:24 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 18:59:24 user nova-compute[75203]:   <metadata>
Nov 28 18:59:24 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 18:59:24 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 18:59:24 user nova-compute[75203]:       <nova:name>tempest-VolumesActionsTest-instance-334219567</nova:name>
Nov 28 18:59:24 user nova-compute[75203]:       <nova:creationTime>2023-11-28 18:59:24</nova:creationTime>
Nov 28 18:59:24 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 18:59:24 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 18:59:24 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 18:59:24 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 18:59:24 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 18:59:24 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 18:59:24 user nova-compute[75203]:       </nova:flavor>
Nov 28 18:59:24 user nova-compute[75203]:       <nova:owner>
Nov 28 18:59:24 user nova-compute[75203]:         <nova:user uuid="350de204ebf54cadb8a3c71049b7ff27">tempest-VolumesActionsTest-1987920535-project-member</nova:user>
Nov 28 18:59:24 user nova-compute[75203]:         <nova:project uuid="cca81c62e02c4570b890ea72f07dfe1d">tempest-VolumesActionsTest-1987920535</nova:project>
Nov 28 18:59:24 user nova-compute[75203]:       </nova:owner>
Nov 28 18:59:24 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 18:59:24 user nova-compute[75203]:       <nova:ports>
Nov 28 18:59:24 user nova-compute[75203]:         <nova:port uuid="ac27d69f-6cfe-41e8-818e-480062c65389">
Nov 28 18:59:24 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 18:59:24 user nova-compute[75203]:         </nova:port>
Nov 28 18:59:24 user nova-compute[75203]:       </nova:ports>
Nov 28 18:59:24 user nova-compute[75203]:     </nova:instance>
Nov 28 18:59:24 user nova-compute[75203]:   </metadata>
Nov 28 18:59:24 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 18:59:24 user nova-compute[75203]:     <system>
Nov 28 18:59:24 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 18:59:24 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 18:59:24 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 18:59:24 user nova-compute[75203]:       <entry name="serial">ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c</entry>
Nov 28 18:59:24 user nova-compute[75203]:       <entry name="uuid">ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c</entry>
Nov 28 18:59:24 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 18:59:24 user nova-compute[75203]:     </system>
Nov 28 18:59:24 user nova-compute[75203]:   </sysinfo>
Nov 28 18:59:24 user nova-compute[75203]:   <os>
Nov 28 18:59:24 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 18:59:24 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 18:59:24 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 18:59:24 user nova-compute[75203]:   </os>
Nov 28 18:59:24 user nova-compute[75203]:   <features>
Nov 28 18:59:24 user nova-compute[75203]:     <acpi/>
Nov 28 18:59:24 user nova-compute[75203]:     <apic/>
Nov 28 18:59:24 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 18:59:24 user nova-compute[75203]:   </features>
Nov 28 18:59:24 user nova-compute[75203]:   <clock offset="utc">
Nov 28 18:59:24 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 18:59:24 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 18:59:24 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 18:59:24 user nova-compute[75203]:   </clock>
Nov 28 18:59:24 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 18:59:24 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 18:59:24 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 18:59:24 user nova-compute[75203]:   </cpu>
Nov 28 18:59:24 user nova-compute[75203]:   <devices>
Nov 28 18:59:24 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 18:59:24 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 18:59:24 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk"/>
Nov 28 18:59:24 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 18:59:24 user nova-compute[75203]:     </disk>
Nov 28 18:59:24 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 18:59:24 user nova-compute[75203]:       <mac address="fa:16:3e:17:7f:62"/>
Nov 28 18:59:24 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:59:24 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 18:59:24 user nova-compute[75203]:       <target dev="tapac27d69f-6c"/>
Nov 28 18:59:24 user nova-compute[75203]:     </interface>
Nov 28 18:59:24 user nova-compute[75203]:     <serial type="pty">
Nov 28 18:59:24 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/console.log" append="off"/>
Nov 28 18:59:24 user nova-compute[75203]:     </serial>
Nov 28 18:59:24 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 18:59:24 user nova-compute[75203]:     <video>
Nov 28 18:59:24 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 18:59:24 user nova-compute[75203]:     </video>
Nov 28 18:59:24 user nova-compute[75203]:     <rng model="virtio">
Nov 28 18:59:24 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 18:59:24 user nova-compute[75203]:     </rng>
Nov 28 18:59:24 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 18:59:24 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 18:59:24 user nova-compute[75203]:       <stats period="10"/>
Nov 28 18:59:24 user nova-compute[75203]:     </memballoon>
Nov 28 18:59:24 user nova-compute[75203]:   </devices>
Nov 28 18:59:24 user nova-compute[75203]: </domain>
Nov 28 18:59:24 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-334219567',display_name='tempest-VolumesActionsTest-instance-334219567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-334219567',id=39,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca81c62e02c4570b890ea72f07dfe1d',ramdisk_id='',reservation_id='r-6wqtr2ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1987920535',owner_user_name='tempest-VolumesActionsTest-1987920535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T18:59:23Z,user_data=None,user_id='350de204ebf54cadb8a3c71049b7ff27',uuid=ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converting VIF {"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=ac27d69f-6cfe-41e8-818e-480062c65389,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac27d69f-6c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG os_vif [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=ac27d69f-6cfe-41e8-818e-480062c65389,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac27d69f-6c') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c87b977f-5ed0-5c29-97c5-3f5eabe7967a', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac27d69f-6c, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac27d69f-6c, col_values=(('qos', UUID('5ebae239-752e-4990-993b-2e54be89171d')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac27d69f-6c, col_values=(('external_ids', {'iface-id': 'ac27d69f-6cfe-41e8-818e-480062c65389', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:7f:62', 'vm-uuid': 'ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:24 user nova-compute[75203]: INFO os_vif [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=ac27d69f-6cfe-41e8-818e-480062c65389,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac27d69f-6c')
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] No VIF found with MAC fa:16:3e:17:7f:62, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Updated VIF entry in instance network info cache for port ac27d69f-6cfe-41e8-818e-480062c65389. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Updating instance_info_cache with network_info: [{"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:59:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6f615105-5e89-49d9-aa76-061d801a4993 req-840a4b49-b6cb-40b3-95c3-e1049d540406 service nova] Releasing lock "refresh_cache-ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-7e5c7910-54f5-4dbc-9d39-0b3ca9fdc4dc req-e3beb985-ed04-4c8d-8073-adb9417b786a service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received event network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7e5c7910-54f5-4dbc-9d39-0b3ca9fdc4dc req-e3beb985-ed04-4c8d-8073-adb9417b786a service nova] Acquiring lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7e5c7910-54f5-4dbc-9d39-0b3ca9fdc4dc req-e3beb985-ed04-4c8d-8073-adb9417b786a service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7e5c7910-54f5-4dbc-9d39-0b3ca9fdc4dc req-e3beb985-ed04-4c8d-8073-adb9417b786a service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-7e5c7910-54f5-4dbc-9d39-0b3ca9fdc4dc req-e3beb985-ed04-4c8d-8073-adb9417b786a service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] No waiting events found dispatching network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:59:26 user nova-compute[75203]: WARNING nova.compute.manager [req-7e5c7910-54f5-4dbc-9d39-0b3ca9fdc4dc req-e3beb985-ed04-4c8d-8073-adb9417b786a service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received unexpected event network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 for instance with vm_state building and task_state spawning.
Nov 28 18:59:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 18:59:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Instance spawned successfully.
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 18:59:28 user nova-compute[75203]: INFO nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-a555580b-dddd-4a95-96bf-b41841e86751 req-d28e075f-41de-4871-9563-fa21bbd4b4d7 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received event network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a555580b-dddd-4a95-96bf-b41841e86751 req-d28e075f-41de-4871-9563-fa21bbd4b4d7 service nova] Acquiring lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a555580b-dddd-4a95-96bf-b41841e86751 req-d28e075f-41de-4871-9563-fa21bbd4b4d7 service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a555580b-dddd-4a95-96bf-b41841e86751 req-d28e075f-41de-4871-9563-fa21bbd4b4d7 service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-a555580b-dddd-4a95-96bf-b41841e86751 req-d28e075f-41de-4871-9563-fa21bbd4b4d7 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] No waiting events found dispatching network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:59:28 user nova-compute[75203]: WARNING nova.compute.manager [req-a555580b-dddd-4a95-96bf-b41841e86751 req-d28e075f-41de-4871-9563-fa21bbd4b4d7 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received unexpected event network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 for instance with vm_state building and task_state spawning.
Nov 28 18:59:28 user nova-compute[75203]: INFO nova.compute.manager [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Took 6.20 seconds to build instance.
Nov 28 18:59:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5fa1ece8-1d11-416b-98bb-d2a391866393 tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.298s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:55 user nova-compute[75203]: INFO nova.compute.manager [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Terminating instance
Nov 28 18:59:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-350c33db-63ae-4f8f-80d6-97fc6dfc4e42 req-e4a215ab-e4a9-4949-bd14-7555d5961fa8 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received event network-vif-unplugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-350c33db-63ae-4f8f-80d6-97fc6dfc4e42 req-e4a215ab-e4a9-4949-bd14-7555d5961fa8 service nova] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-350c33db-63ae-4f8f-80d6-97fc6dfc4e42 req-e4a215ab-e4a9-4949-bd14-7555d5961fa8 service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-350c33db-63ae-4f8f-80d6-97fc6dfc4e42 req-e4a215ab-e4a9-4949-bd14-7555d5961fa8 service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-350c33db-63ae-4f8f-80d6-97fc6dfc4e42 req-e4a215ab-e4a9-4949-bd14-7555d5961fa8 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] No waiting events found dispatching network-vif-unplugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:59:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-350c33db-63ae-4f8f-80d6-97fc6dfc4e42 req-e4a215ab-e4a9-4949-bd14-7555d5961fa8 service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received event network-vif-unplugged-2970e046-add1-4749-9206-0a5e9570298d for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 18:59:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Instance destroyed successfully.
Nov 28 18:59:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'resources' on Instance uuid e2b743b9-0ec7-43a6-a18b-c72621c2cf60 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:50:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1587903930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1587903930',id=32,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-676zrrgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:52:29Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=e2b743b9-0ec7-43a6-a18b-c72621c2cf60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "2970e046-add1-4749-9206-0a5e9570298d", "address": "fa:16:3e:9e:f5:66", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2970e046-ad", "ovs_interfaceid": "2970e046-add1-4749-9206-0a5e9570298d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f5:66,bridge_name='br-int',has_traffic_filtering=True,id=2970e046-add1-4749-9206-0a5e9570298d,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970e046-ad') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG os_vif [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f5:66,bridge_name='br-int',has_traffic_filtering=True,id=2970e046-add1-4749-9206-0a5e9570298d,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970e046-ad') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2970e046-ad, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1731614e-6227-48f7-8514-f65cea6c0504) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 18:59:56 user nova-compute[75203]: INFO os_vif [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:f5:66,bridge_name='br-int',has_traffic_filtering=True,id=2970e046-add1-4749-9206-0a5e9570298d,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2970e046-ad')
Nov 28 18:59:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Deleting instance files /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60_del
Nov 28 18:59:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Deletion of /opt/stack/data/nova/instances/e2b743b9-0ec7-43a6-a18b-c72621c2cf60_del complete
Nov 28 18:59:56 user nova-compute[75203]: INFO nova.compute.manager [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:56 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Error from libvirt while getting description of instance-00000020: [Error Code 42] Domain not found: no domain with matching uuid 'e2b743b9-0ec7-43a6-a18b-c72621c2cf60' (instance-00000020): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e2b743b9-0ec7-43a6-a18b-c72621c2cf60' (instance-00000020)
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 18:59:56 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Took 0.78 seconds to deallocate network for instance.
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:57 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Deleted allocations for instance e2b743b9-0ec7-43a6-a18b-c72621c2cf60
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1633c421-a7ce-4122-a395-358b8d305ecb tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.963s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 18:59:57 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-7967db60-922e-4e95-9e7a-b93ddd81274b req-1fa70930-cfbc-43d5-a963-18ba6c3acd2f service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received event network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7967db60-922e-4e95-9e7a-b93ddd81274b req-1fa70930-cfbc-43d5-a963-18ba6c3acd2f service nova] Acquiring lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7967db60-922e-4e95-9e7a-b93ddd81274b req-1fa70930-cfbc-43d5-a963-18ba6c3acd2f service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7967db60-922e-4e95-9e7a-b93ddd81274b req-1fa70930-cfbc-43d5-a963-18ba6c3acd2f service nova] Lock "e2b743b9-0ec7-43a6-a18b-c72621c2cf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-7967db60-922e-4e95-9e7a-b93ddd81274b req-1fa70930-cfbc-43d5-a963-18ba6c3acd2f service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] No waiting events found dispatching network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 18:59:58 user nova-compute[75203]: WARNING nova.compute.manager [req-7967db60-922e-4e95-9e7a-b93ddd81274b req-1fa70930-cfbc-43d5-a963-18ba6c3acd2f service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received unexpected event network-vif-plugged-2970e046-add1-4749-9206-0a5e9570298d for instance with vm_state deleted and task_state None.
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.manager [req-7967db60-922e-4e95-9e7a-b93ddd81274b req-1fa70930-cfbc-43d5-a963-18ba6c3acd2f service nova] [instance: e2b743b9-0ec7-43a6-a18b-c72621c2cf60] Received event network-vif-deleted-2970e046-add1-4749-9206-0a5e9570298d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 18:59:58 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:59:58 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=24.873340606689453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 33b41c79-f029-473d-b6c8-8b3ec206be68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 18:59:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 18:59:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 18:59:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:00:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:00:06 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid e170916d-ac84-400b-96b6-62d4b5919980 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:00:07 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [{"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:00:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-e170916d-ac84-400b-96b6-62d4b5919980" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:00:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:00:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-changed-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:00:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Refreshing instance network info cache due to event network-changed-368b563c-1b4e-4a21-9e90-45fc8a757cb3. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:00:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] Acquiring lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:00:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] Acquired lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:00:08 user nova-compute[75203]: DEBUG nova.network.neutron [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Refreshing network info cache for port 368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:00:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updated VIF entry in instance network info cache for port 368b563c-1b4e-4a21-9e90-45fc8a757cb3. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:00:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updating instance_info_cache with network_info: [{"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:00:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-19fff085-5045-40f5-a105-93caa48fd156 req-0f6dabec-b8f8-4268-8691-86c9e3c3665f service nova] Releasing lock "refresh_cache-efe7cbf2-3fc0-4a69-95ba-368141bb8f99" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid efe7cbf2-3fc0-4a69-95ba-368141bb8f99 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:11 user nova-compute[75203]: INFO nova.compute.manager [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Attaching volume 6834924b-5dda-4bf5-ac9c-d356b0bf62ba to /dev/vdb
Nov 28 19:00:11 user nova-compute[75203]: DEBUG os_brick.utils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[413b0caa-f792-4213-be32-61735b286274]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc4296-b273-455e-bba7-a463d8aca8ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8c974d-1f63-4f54-972e-316237aca7cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b8766-0f73-4b57-b2e8-139440a7938a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:00:11 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:00:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ca482-e39e-4482-a5d3-b0f6bbf7a8d0]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG os_brick.utils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:00:11 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updating existing volume attachment record: c4225265-e95c-485c-bf6d-cd9e056e9dc5 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:00:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHXdLAKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:00:18 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:00:18 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:00:18 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b05c269-b004-423d-9f7e-ff15650ba961]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:00:18 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[314298ad-2d30-423e-b507-c9aa640a2a4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba] added
Nov 28 19:00:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6edd1-3d4c-456e-a9fc-6f4a64cecab6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d6e964-4790-4909-b10b-82fd5886c534]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHXdLAKy {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHXdLAKy" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea8a1ba-3f36-4e30-91fd-2738d29bd212]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHXdLAKy'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b0a5f7-3d9f-4cf2-8c4d-a08af62ce68e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd295f3-d501-45b5-a118-6e414d7d680a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:18 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:18 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d03407-649f-4e94-a159-d7ea7835cab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260]
Nov 28 19:00:18 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260] successful.
Nov 28 19:00:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2741200-450a-47d7-b7b8-3b78fd40a3f4]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e695ff-6001-490a-b669-0dcc6d3be7ef]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:18 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:18 user nova-compute[75203]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba (non-flash)
Nov 28 19:00:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:18 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:18 user nova-compute[75203]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba (non-flash)
Nov 28 19:00:18 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[614472a5-100d-4587-b2b2-63140cbeb575]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:00:18 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHXdLAKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:00:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:00:19 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26131363034326139', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:00:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131363034326139', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:00:19 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid efe7cbf2-3fc0-4a69-95ba-368141bb8f99 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:00:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 19:00:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:00:19 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 19:00:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:00:19 user nova-compute[75203]:   <serial>6834924b-5dda-4bf5-ac9c-d356b0bf62ba</serial>
Nov 28 19:00:19 user nova-compute[75203]: </disk>
Nov 28 19:00:19 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 19:00:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:00:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:00:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] No VIF found with MAC fa:16:3e:4b:cb:c4, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:00:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d90e3334-9321-4add-b528-6121b91f542d tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.749s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:21 user nova-compute[75203]: INFO nova.compute.manager [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Detaching volume 6834924b-5dda-4bf5-ac9c-d356b0bf62ba
Nov 28 19:00:21 user nova-compute[75203]: INFO nova.virt.block_device [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Attempting to driver detach volume 6834924b-5dda-4bf5-ac9c-d356b0bf62ba from mountpoint /dev/vdb
Nov 28 19:00:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Attempting to detach device vdb from instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:00:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:00:21 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:00:21 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 19:00:21 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:00:21 user nova-compute[75203]:   <serial>6834924b-5dda-4bf5-ac9c-d356b0bf62ba</serial>
Nov 28 19:00:21 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:00:21 user nova-compute[75203]: </disk>
Nov 28 19:00:21 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:00:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully detached device vdb from instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 from the persistent domain config.
Nov 28 19:00:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:00:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:00:21 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:00:21 user nova-compute[75203]:   <source dev="/dev/sdd"/>
Nov 28 19:00:21 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:00:21 user nova-compute[75203]:   <serial>6834924b-5dda-4bf5-ac9c-d356b0bf62ba</serial>
Nov 28 19:00:21 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:00:21 user nova-compute[75203]: </disk>
Nov 28 19:00:21 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:00:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:00:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:00:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:37 user nova-compute[75203]: INFO nova.compute.manager [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Detaching volume a2ee3427-c105-49ed-815a-18e7fc61e62f
Nov 28 19:00:37 user nova-compute[75203]: INFO nova.virt.block_device [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Attempting to driver detach volume a2ee3427-c105-49ed-815a-18e7fc61e62f from mountpoint /dev/vdb
Nov 28 19:00:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Attempting to detach device vdb from instance 17161f39-18b4-488b-871d-bc8e9e8faa00 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:00:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:00:37 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:00:37 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:00:37 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:00:37 user nova-compute[75203]:   <serial>a2ee3427-c105-49ed-815a-18e7fc61e62f</serial>
Nov 28 19:00:37 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 19:00:37 user nova-compute[75203]: </disk>
Nov 28 19:00:37 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:00:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully detached device vdb from instance 17161f39-18b4-488b-871d-bc8e9e8faa00 from the persistent domain config.
Nov 28 19:00:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17161f39-18b4-488b-871d-bc8e9e8faa00 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:00:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:00:37 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:00:37 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:00:37 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:00:37 user nova-compute[75203]:   <serial>a2ee3427-c105-49ed-815a-18e7fc61e62f</serial>
Nov 28 19:00:37 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 19:00:37 user nova-compute[75203]: </disk>
Nov 28 19:00:37 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:00:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:00:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:42 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 is timed out.
Nov 28 19:00:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully detached device vdb from instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 from the live domain config.
Nov 28 19:00:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHXdLAKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:00:42 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a86f4cc-80e8-4b5b-940d-cc62100ae90b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:00:42 user nova-compute[75203]: No targets found.
Nov 28 19:00:42 user nova-compute[75203]: iSNS:
Nov 28 19:00:42 user nova-compute[75203]: No targets found.
Nov 28 19:00:42 user nova-compute[75203]: STATIC:
Nov 28 19:00:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f
Nov 28 19:00:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:00:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:00:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 19:00:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:00:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:00:42 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba
Nov 28 19:00:42 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:00:42 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:00:42 user nova-compute[75203]: FIRMWARE:
Nov 28 19:00:42 user nova-compute[75203]: No targets found.
Nov 28 19:00:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:00:42 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:00:42 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e786f-6d2a-42d5-a002-4eefa71c506a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac12304d-fe4d-48d1-97e4-aecd37167bac]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:42 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:42 user nova-compute[75203]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba (non-flash)
Nov 28 19:00:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:42 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:42 user nova-compute[75203]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba (non-flash)
Nov 28 19:00:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07901f4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba'): ({'sdd'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Removing single pathed devices sdd {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c765bd6-25f6-4039-b1b3-375094a23b99]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d6794-af56-4840-ae19-57c00a18948e]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Flushing IO for device /dev/sdd {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7625056-304b-4d92-9b9a-bf0e626bb043]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6163cd-4d0d-4a1b-8a61-f9ec47f8f31c]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9342af19-574f-4be6-87c1-6d7ad4eab54c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab581c51-8198-43fa-9533-1ff190aeae91]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260]
Nov 28 19:00:42 user nova-compute[75203]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba, portal: 172.16.0.220,3260] successful.
Nov 28 19:00:42 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6834924b-5dda-4bf5-ac9c-d356b0bf62ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed75ef5-3d9b-47a7-81d6-66cf24c0af86]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] <== disconnect_volume: return (292ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:00:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:00:43 user nova-compute[75203]: DEBUG nova.objects.instance [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'flavor' on Instance uuid efe7cbf2-3fc0-4a69-95ba-368141bb8f99 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:00:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-44a1f72e-9bd5-4966-a15a-ba47dcf6cbb9 tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:46 user nova-compute[75203]: INFO nova.compute.manager [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Terminating instance
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-83f19f05-31c1-481b-99e1-4ebfcd526e41 req-d5fe4c52-7b76-4fff-83f0-4234b0f82f39 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-83f19f05-31c1-481b-99e1-4ebfcd526e41 req-d5fe4c52-7b76-4fff-83f0-4234b0f82f39 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-83f19f05-31c1-481b-99e1-4ebfcd526e41 req-d5fe4c52-7b76-4fff-83f0-4234b0f82f39 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-83f19f05-31c1-481b-99e1-4ebfcd526e41 req-d5fe4c52-7b76-4fff-83f0-4234b0f82f39 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-83f19f05-31c1-481b-99e1-4ebfcd526e41 req-d5fe4c52-7b76-4fff-83f0-4234b0f82f39 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.compute.manager [req-83f19f05-31c1-481b-99e1-4ebfcd526e41 req-d5fe4c52-7b76-4fff-83f0-4234b0f82f39 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-unplugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Instance destroyed successfully.
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.objects.instance [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'resources' on Instance uuid 33b41c79-f029-473d-b6c8-8b3ec206be68 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1657601046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1657601046',id=24,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:46:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-z19gbbkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:48:46Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=33b41c79-f029-473d-b6c8-8b3ec206be68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "address": "fa:16:3e:9d:09:68", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d772bbd-71", "ovs_interfaceid": "9d772bbd-714c-4603-9a31-3ed495ebc5a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_vif [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d772bbd-71, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a7a94d5-4611-4c7a-a176-f64a28eaf591) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:00:46 user nova-compute[75203]: INFO os_vif [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:09:68,bridge_name='br-int',has_traffic_filtering=True,id=9d772bbd-714c-4603-9a31-3ed495ebc5a5,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d772bbd-71')
Nov 28 19:00:46 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyCxeuVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:00:46 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd1a3e4-cbc0-4dde-848e-ffb19de4fb34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:00:46 user nova-compute[75203]: No targets found.
Nov 28 19:00:46 user nova-compute[75203]: iSNS:
Nov 28 19:00:46 user nova-compute[75203]: No targets found.
Nov 28 19:00:46 user nova-compute[75203]: STATIC:
Nov 28 19:00:46 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f
Nov 28 19:00:46 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:00:46 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:00:46 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e
Nov 28 19:00:46 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:00:46 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:00:46 user nova-compute[75203]: FIRMWARE:
Nov 28 19:00:46 user nova-compute[75203]: No targets found.
Nov 28 19:00:46 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:00:46 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:00:46 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[be231cc5-8234-46f3-aca8-4eabf3663efc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd45caa7-0b50-4617-bcfe-713f55645941]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:46 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:46 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e (non-flash)
Nov 28 19:00:46 user nova-compute[75203]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:46 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790103370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ccc359-d311-4636-8588-914098bb77ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fbe124-9e10-4ea2-995a-010e23f7198a]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1083532-583d-4b72-b085-eff8818136d3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:00:46 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e8bea9-ec0e-463a-8431-aa3f05998e6d]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec523bc-6862-4e67-936e-c7c3db4a59fe]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[34370030-e25e-4608-8f38-9d0633074c6d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260]
Nov 28 19:00:47 user nova-compute[75203]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e, portal: 172.16.0.220,3260] successful.
Nov 28 19:00:47 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc5ab62-885a-471f-af6d-e8fd39051f1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[747715ad-be1f-49c0-841e-f88662d71fd1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] <== disconnect_volume: return (271ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:00:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Deleting instance files /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68_del
Nov 28 19:00:47 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Deletion of /opt/stack/data/nova/instances/33b41c79-f029-473d-b6c8-8b3ec206be68_del complete
Nov 28 19:00:47 user nova-compute[75203]: INFO nova.compute.manager [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 28 19:00:47 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:00:47 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:00:47 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Took 0.45 seconds to deallocate network for instance.
Nov 28 19:00:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-965db178-60bd-44c1-bab9-076536f21f8f req-75b0a502-9fb4-48e0-9f45-a61ebaf79510 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-deleted-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:48 user nova-compute[75203]: INFO nova.compute.manager [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Took 0.82 seconds to detach 1 volumes for instance.
Nov 28 19:00:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-6930d018-ceb9-4c5f-8e84-662b46224bfb req-adae224a-9bb1-4aba-9eb8-b6007fab1fd6 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6930d018-ceb9-4c5f-8e84-662b46224bfb req-adae224a-9bb1-4aba-9eb8-b6007fab1fd6 service nova] Acquiring lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6930d018-ceb9-4c5f-8e84-662b46224bfb req-adae224a-9bb1-4aba-9eb8-b6007fab1fd6 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6930d018-ceb9-4c5f-8e84-662b46224bfb req-adae224a-9bb1-4aba-9eb8-b6007fab1fd6 service nova] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-6930d018-ceb9-4c5f-8e84-662b46224bfb req-adae224a-9bb1-4aba-9eb8-b6007fab1fd6 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] No waiting events found dispatching network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:00:48 user nova-compute[75203]: WARNING nova.compute.manager [req-6930d018-ceb9-4c5f-8e84-662b46224bfb req-adae224a-9bb1-4aba-9eb8-b6007fab1fd6 service nova] [instance: 33b41c79-f029-473d-b6c8-8b3ec206be68] Received unexpected event network-vif-plugged-9d772bbd-714c-4603-9a31-3ed495ebc5a5 for instance with vm_state active and task_state deleting.
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:48 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Deleted allocations for instance 33b41c79-f029-473d-b6c8-8b3ec206be68
Nov 28 19:00:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-59c24ddd-ff17-4527-a943-d98020e8d246 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "33b41c79-f029-473d-b6c8-8b3ec206be68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.770s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:00:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:00:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:00:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:00:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:00:57 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17161f39-18b4-488b-871d-bc8e9e8faa00 is timed out.
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully detached device vdb from instance 17161f39-18b4-488b-871d-bc8e9e8faa00 from the live domain config.
Nov 28 19:00:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpjgyThw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:00:58 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d91ae5-ecb9-44c4-ad73-5b1bc2ff9a47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:00:58 user nova-compute[75203]: No targets found.
Nov 28 19:00:58 user nova-compute[75203]: iSNS:
Nov 28 19:00:58 user nova-compute[75203]: No targets found.
Nov 28 19:00:58 user nova-compute[75203]: STATIC:
Nov 28 19:00:58 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f
Nov 28 19:00:58 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:00:58 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:00:58 user nova-compute[75203]: FIRMWARE:
Nov 28 19:00:58 user nova-compute[75203]: No targets found.
Nov 28 19:00:58 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:00:58 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:00:58 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c66126-ee84-4559-9daa-8e9413ca9ad7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0406415-4530-42ea-a5fb-831788c17f8c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:58 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f (non-flash)
Nov 28 19:00:58 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f079018a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd26f36-2b51-4f68-a4a6-941e47b31d50]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f9348-04db-4a5c-a250-12750a5c8454]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f526bfd-5daf-4049-9d0c-c3d24865c1fd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[114e37a6-f0ca-4b27-9cb7-3c6a7c3450bc]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6807485d-c469-4579-bc33-1387575d1de2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e4bf57-c4b7-452c-9a00-21f50780489b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260]
Nov 28 19:00:58 user nova-compute[75203]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f, portal: 172.16.0.220,3260] successful.
Nov 28 19:00:58 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2ee3427-c105-49ed-815a-18e7fc61e62f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d010a3d-2a1d-40de-868a-11955808e36a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== disconnect_volume: return (367ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG nova.objects.instance [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:00:59 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:00:59 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:00:59 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=24.899452209472656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-807fdc56-1aa8-4d0b-8118-4d01e0873401 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.921s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:00:59 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e170916d-ac84-400b-96b6-62d4b5919980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-85bfab30-2590-492e-aaeb-0d202ae29737 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-85bfab30-2590-492e-aaeb-0d202ae29737 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-85bfab30-2590-492e-aaeb-0d202ae29737 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-85bfab30-2590-492e-aaeb-0d202ae29737 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75203) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-85bfab30-2590-492e-aaeb-0d202ae29737 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-b53397ad-46a4-456d-8da3-aa6070e436c4 req-0d681096-4de7-4681-a263-383b600c3d33 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b53397ad-46a4-456d-8da3-aa6070e436c4 req-0d681096-4de7-4681-a263-383b600c3d33 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b53397ad-46a4-456d-8da3-aa6070e436c4 req-0d681096-4de7-4681-a263-383b600c3d33 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b53397ad-46a4-456d-8da3-aa6070e436c4 req-0d681096-4de7-4681-a263-383b600c3d33 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-b53397ad-46a4-456d-8da3-aa6070e436c4 req-0d681096-4de7-4681-a263-383b600c3d33 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:00 user nova-compute[75203]: WARNING nova.compute.manager [req-b53397ad-46a4-456d-8da3-aa6070e436c4 req-0d681096-4de7-4681-a263-383b600c3d33 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state active and task_state powering-off.
Nov 28 19:01:01 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance destroyed successfully.
Nov 28 19:01:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-85bfab30-2590-492e-aaeb-0d202ae29737 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:01:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-85bfab30-2590-492e-aaeb-0d202ae29737 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.836s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-4094c410-e02b-419b-b85e-f6ba57a0cac9 req-5a760e6f-ad60-4e3a-a3dc-534ed0442bf0 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4094c410-e02b-419b-b85e-f6ba57a0cac9 req-5a760e6f-ad60-4e3a-a3dc-534ed0442bf0 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4094c410-e02b-419b-b85e-f6ba57a0cac9 req-5a760e6f-ad60-4e3a-a3dc-534ed0442bf0 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4094c410-e02b-419b-b85e-f6ba57a0cac9 req-5a760e6f-ad60-4e3a-a3dc-534ed0442bf0 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-4094c410-e02b-419b-b85e-f6ba57a0cac9 req-5a760e6f-ad60-4e3a-a3dc-534ed0442bf0 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:02 user nova-compute[75203]: WARNING nova.compute.manager [req-4094c410-e02b-419b-b85e-f6ba57a0cac9 req-5a760e6f-ad60-4e3a-a3dc-534ed0442bf0 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state stopped and task_state None.
Nov 28 19:01:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:01:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:01:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:01:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:01:07 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:01:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:01:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:01:09 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:01:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:01:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:01:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:01:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:12 user nova-compute[75203]: INFO nova.compute.manager [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Terminating instance
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-87350b9b-b55d-44c8-98f7-7ca1c95feed5 req-3495744a-350d-453a-a6a1-4623111cdc9d service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-vif-unplugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-87350b9b-b55d-44c8-98f7-7ca1c95feed5 req-3495744a-350d-453a-a6a1-4623111cdc9d service nova] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-87350b9b-b55d-44c8-98f7-7ca1c95feed5 req-3495744a-350d-453a-a6a1-4623111cdc9d service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-87350b9b-b55d-44c8-98f7-7ca1c95feed5 req-3495744a-350d-453a-a6a1-4623111cdc9d service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-87350b9b-b55d-44c8-98f7-7ca1c95feed5 req-3495744a-350d-453a-a6a1-4623111cdc9d service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] No waiting events found dispatching network-vif-unplugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-87350b9b-b55d-44c8-98f7-7ca1c95feed5 req-3495744a-350d-453a-a6a1-4623111cdc9d service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-vif-unplugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:12 user nova-compute[75203]: INFO nova.compute.manager [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Terminating instance
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:01:12 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Instance destroyed successfully.
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lazy-loading 'resources' on Instance uuid efe7cbf2-3fc0-4a69-95ba-368141bb8f99 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1710164239',display_name='tempest-AttachVolumeNegativeTest-server-1710164239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1710164239',id=38,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhmIOR7MynFlObSZAZBcGnJSvTw+GlSxWUfO8pL+m6YtlMLyivdWmsbpThKcTTnfRNIpjQXvvZweZk1Csn9Z5SQL2lmYT3B05lT99cr/5rMo5OOzzOoiowt5q420ecKXA==',key_name='tempest-keypair-1504387575',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40e597eb0284510980106d2de8c235b',ramdisk_id='',reservation_id='r-2s4gkoox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-977864769',owner_user_name='tempest-AttachVolumeNegativeTest-977864769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0355eaade04b2b9d377a6b2c78585e',uuid=efe7cbf2-3fc0-4a69-95ba-368141bb8f99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converting VIF {"id": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "address": "fa:16:3e:4b:cb:c4", "network": {"id": "13147170-1dea-48fa-baef-962f9286ca4d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1669322850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40e597eb0284510980106d2de8c235b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b563c-1b", "ovs_interfaceid": "368b563c-1b4e-4a21-9e90-45fc8a757cb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cb:c4,bridge_name='br-int',has_traffic_filtering=True,id=368b563c-1b4e-4a21-9e90-45fc8a757cb3,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b563c-1b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG os_vif [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cb:c4,bridge_name='br-int',has_traffic_filtering=True,id=368b563c-1b4e-4a21-9e90-45fc8a757cb3,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b563c-1b') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap368b563c-1b, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f8fc2b3-75f8-4b6a-ab8f-9ffb6c10b5d9) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: INFO os_vif [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:cb:c4,bridge_name='br-int',has_traffic_filtering=True,id=368b563c-1b4e-4a21-9e90-45fc8a757cb3,network=Network(13147170-1dea-48fa-baef-962f9286ca4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b563c-1b')
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Deleting instance files /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99_del
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Deletion of /opt/stack/data/nova/instances/efe7cbf2-3fc0-4a69-95ba-368141bb8f99_del complete
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.compute.manager [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 28 19:01:13 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Instance destroyed successfully.
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lazy-loading 'resources' on Instance uuid ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-334219567',display_name='tempest-VolumesActionsTest-instance-334219567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-334219567',id=39,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cca81c62e02c4570b890ea72f07dfe1d',ramdisk_id='',reservation_id='r-6wqtr2ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1987920535',owner_user_name='tempest-VolumesActionsTest-1987920535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:59:28Z,user_data=None,user_id='350de204ebf54cadb8a3c71049b7ff27',uuid=ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converting VIF {"id": "ac27d69f-6cfe-41e8-818e-480062c65389", "address": "fa:16:3e:17:7f:62", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac27d69f-6c", "ovs_interfaceid": "ac27d69f-6cfe-41e8-818e-480062c65389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=ac27d69f-6cfe-41e8-818e-480062c65389,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac27d69f-6c') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG os_vif [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=ac27d69f-6cfe-41e8-818e-480062c65389,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac27d69f-6c') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac27d69f-6c, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ebae239-752e-4990-993b-2e54be89171d) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:13 user nova-compute[75203]: INFO os_vif [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:7f:62,bridge_name='br-int',has_traffic_filtering=True,id=ac27d69f-6cfe-41e8-818e-480062c65389,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac27d69f-6c')
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Deleting instance files /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c_del
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Deletion of /opt/stack/data/nova/instances/ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c_del complete
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.compute.manager [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 19:01:13 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Took 0.74 seconds to deallocate network for instance.
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-63400bb0-8690-4058-8cd1-fe6338ff49eb req-066ddcad-086e-4a6b-9cbf-7b6f9d6b7773 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-vif-deleted-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:13 user nova-compute[75203]: INFO nova.compute.manager [req-63400bb0-8690-4058-8cd1-fe6338ff49eb req-066ddcad-086e-4a6b-9cbf-7b6f9d6b7773 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Neutron deleted interface 368b563c-1b4e-4a21-9e90-45fc8a757cb3; detaching it from the instance and deleting it from the info cache
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-63400bb0-8690-4058-8cd1-fe6338ff49eb req-066ddcad-086e-4a6b-9cbf-7b6f9d6b7773 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-63400bb0-8690-4058-8cd1-fe6338ff49eb req-066ddcad-086e-4a6b-9cbf-7b6f9d6b7773 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Detach interface failed, port_id=368b563c-1b4e-4a21-9e90-45fc8a757cb3, reason: Instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:14 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Took 0.41 seconds to deallocate network for instance.
Nov 28 19:01:14 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Deleted allocations for instance efe7cbf2-3fc0-4a69-95ba-368141bb8f99
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-4b005df7-0a99-43f7-bd58-c9ca514d854a req-e6ed116d-e586-4a2d-a6d7-9e852caa732f service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received event network-vif-deleted-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1236115-d440-4271-8641-dcd59ed95a5e tempest-AttachVolumeNegativeTest-977864769 tempest-AttachVolumeNegativeTest-977864769-project-member] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:14 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Deleted allocations for instance ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received event network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Acquiring lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Lock "efe7cbf2-3fc0-4a69-95ba-368141bb8f99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] No waiting events found dispatching network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:14 user nova-compute[75203]: WARNING nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: efe7cbf2-3fc0-4a69-95ba-368141bb8f99] Received unexpected event network-vif-plugged-368b563c-1b4e-4a21-9e90-45fc8a757cb3 for instance with vm_state deleted and task_state None.
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received event network-vif-unplugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Acquiring lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] No waiting events found dispatching network-vif-unplugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:14 user nova-compute[75203]: WARNING nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received unexpected event network-vif-unplugged-ac27d69f-6cfe-41e8-818e-480062c65389 for instance with vm_state deleted and task_state None.
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received event network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Acquiring lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] No waiting events found dispatching network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:14 user nova-compute[75203]: WARNING nova.compute.manager [req-1c8ea8af-af84-4265-b950-c67ee41e0e81 req-3706dba2-5f62-4825-9433-b22e71c10188 service nova] [instance: ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c] Received unexpected event network-vif-plugged-ac27d69f-6cfe-41e8-818e-480062c65389 for instance with vm_state deleted and task_state None.
Nov 28 19:01:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ef44668f-4d1c-4d71-9e9a-ac556005c72f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "ef0cc75c-b377-41e6-bd9a-e9f228dd1e0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.609s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_power_states {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid e170916d-ac84-400b-96b6-62d4b5919980 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "e170916d-ac84-400b-96b6-62d4b5919980" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "e170916d-ac84-400b-96b6-62d4b5919980" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:01:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:01:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e170916d-ac84-400b-96b6-62d4b5919980" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:36 user nova-compute[75203]: INFO nova.compute.manager [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Terminating instance
Nov 28 19:01:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-c80db886-bf8d-4f3b-98aa-2e0586cbb6c5 req-f91cbe7c-a663-4788-a232-9769ce580af3 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received event network-vif-unplugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c80db886-bf8d-4f3b-98aa-2e0586cbb6c5 req-f91cbe7c-a663-4788-a232-9769ce580af3 service nova] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c80db886-bf8d-4f3b-98aa-2e0586cbb6c5 req-f91cbe7c-a663-4788-a232-9769ce580af3 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c80db886-bf8d-4f3b-98aa-2e0586cbb6c5 req-f91cbe7c-a663-4788-a232-9769ce580af3 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-c80db886-bf8d-4f3b-98aa-2e0586cbb6c5 req-f91cbe7c-a663-4788-a232-9769ce580af3 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] No waiting events found dispatching network-vif-unplugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-c80db886-bf8d-4f3b-98aa-2e0586cbb6c5 req-f91cbe7c-a663-4788-a232-9769ce580af3 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received event network-vif-unplugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:01:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Instance destroyed successfully.
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.objects.instance [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lazy-loading 'resources' on Instance uuid e170916d-ac84-400b-96b6-62d4b5919980 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-960714552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-960714552',id=20,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:42:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eec1aaec341d441fb4da4fc53a985617',ramdisk_id='',reservation_id='r-0m8uorp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T18:43:55Z,user_data=None,user_id='ad9a9772df954da0b42b5b102440c1d0',uuid=e170916d-ac84-400b-96b6-62d4b5919980,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converting VIF {"id": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "address": "fa:16:3e:38:1d:b3", "network": {"id": "38b0c8de-c29e-4768-b39b-38476af09d33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-87571019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eec1aaec341d441fb4da4fc53a985617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap415ec5d9-72", "ovs_interfaceid": "415ec5d9-72d2-41e9-857c-a9f8b5058196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=415ec5d9-72d2-41e9-857c-a9f8b5058196,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415ec5d9-72') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG os_vif [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=415ec5d9-72d2-41e9-857c-a9f8b5058196,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415ec5d9-72') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap415ec5d9-72, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10d41ff9-26d7-4bdd-a9db-deb53f5fbe72) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:37 user nova-compute[75203]: INFO os_vif [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=415ec5d9-72d2-41e9-857c-a9f8b5058196,network=Network(38b0c8de-c29e-4768-b39b-38476af09d33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap415ec5d9-72')
Nov 28 19:01:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Deleting instance files /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980_del
Nov 28 19:01:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Deletion of /opt/stack/data/nova/instances/e170916d-ac84-400b-96b6-62d4b5919980_del complete
Nov 28 19:01:37 user nova-compute[75203]: INFO nova.compute.manager [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 28 19:01:37 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:01:37 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e170916d-ac84-400b-96b6-62d4b5919980] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:01:38 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:01:38 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Took 0.42 seconds to deallocate network for instance.
Nov 28 19:01:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-5986938f-980d-48a0-a3e8-ff162717f279 req-c41a938d-8ea1-46ab-a0ff-5446a4e4eb19 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received event network-vif-deleted-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:38 user nova-compute[75203]: INFO nova.compute.manager [req-5986938f-980d-48a0-a3e8-ff162717f279 req-c41a938d-8ea1-46ab-a0ff-5446a4e4eb19 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Neutron deleted interface 415ec5d9-72d2-41e9-857c-a9f8b5058196; detaching it from the instance and deleting it from the info cache
Nov 28 19:01:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-5986938f-980d-48a0-a3e8-ff162717f279 req-c41a938d-8ea1-46ab-a0ff-5446a4e4eb19 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:01:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-5986938f-980d-48a0-a3e8-ff162717f279 req-c41a938d-8ea1-46ab-a0ff-5446a4e4eb19 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Detach interface failed, port_id=415ec5d9-72d2-41e9-857c-a9f8b5058196, reason: Instance e170916d-ac84-400b-96b6-62d4b5919980 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 19:01:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:38 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:01:38 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:01:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:38 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Deleted allocations for instance e170916d-ac84-400b-96b6-62d4b5919980
Nov 28 19:01:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-4a7e7ab2-c6df-4f70-b05d-3ba89b3a73d7 tempest-ServerBootFromVolumeStableRescueTest-1173209255 tempest-ServerBootFromVolumeStableRescueTest-1173209255-project-member] Lock "e170916d-ac84-400b-96b6-62d4b5919980" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.574s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-7438632c-7552-47c3-9571-63e0477bb0f4 req-8a5e0424-eeb3-40d2-a984-4d5ed4c79453 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received event network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:01:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7438632c-7552-47c3-9571-63e0477bb0f4 req-8a5e0424-eeb3-40d2-a984-4d5ed4c79453 service nova] Acquiring lock "e170916d-ac84-400b-96b6-62d4b5919980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7438632c-7552-47c3-9571-63e0477bb0f4 req-8a5e0424-eeb3-40d2-a984-4d5ed4c79453 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7438632c-7552-47c3-9571-63e0477bb0f4 req-8a5e0424-eeb3-40d2-a984-4d5ed4c79453 service nova] Lock "e170916d-ac84-400b-96b6-62d4b5919980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-7438632c-7552-47c3-9571-63e0477bb0f4 req-8a5e0424-eeb3-40d2-a984-4d5ed4c79453 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] No waiting events found dispatching network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:01:39 user nova-compute[75203]: WARNING nova.compute.manager [req-7438632c-7552-47c3-9571-63e0477bb0f4 req-8a5e0424-eeb3-40d2-a984-4d5ed4c79453 service nova] [instance: e170916d-ac84-400b-96b6-62d4b5919980] Received unexpected event network-vif-plugged-415ec5d9-72d2-41e9-857c-a9f8b5058196 for instance with vm_state deleted and task_state None.
Nov 28 19:01:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:01:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:56 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:01:57 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:01:58 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:01:59 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:01:59 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:01:59 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=25.079425811767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:01:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:02 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:02:04 user nova-compute[75203]: INFO nova.compute.claims [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Claim successful on node user
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.network.neutron [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:02:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.policy [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '350de204ebf54cadb8a3c71049b7ff27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cca81c62e02c4570b890ea72f07dfe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:02:04 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Creating image(s)
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "/opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "/opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "/opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk 1073741824" returned: 0 in 0.060s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG nova.network.neutron [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Successfully created port: fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Cannot resize image /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Ensure instance console log exists: /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Successfully updated port: fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "refresh_cache-bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquired lock "refresh_cache-bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received event network-changed-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.compute.manager [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Refreshing instance network info cache due to event network-changed-fa3f5368-d7fa-4d01-b243-2434ec970091. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] Acquiring lock "refresh_cache-bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Updating instance_info_cache with network_info: [{"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Releasing lock "refresh_cache-bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Instance network_info: |[{"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] Acquired lock "refresh_cache-bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Refreshing network info cache for port fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Start _get_guest_xml network_info=[{"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:02:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:02:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1433799762',display_name='tempest-VolumesActionsTest-instance-1433799762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1433799762',id=40,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca81c62e02c4570b890ea72f07dfe1d',ramdisk_id='',reservation_id='r-xy3yf7ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1987920535',owner_user_name='tempest-VolumesActionsTest-1987920535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:02:05Z,user_data=None,user_id='350de204ebf54cadb8a3c71049b7ff27',uuid=bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converting VIF {"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa3f5368-d7fa-4d01-b243-2434ec970091,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3f5368-d7') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.objects.instance [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lazy-loading 'pci_devices' on Instance uuid bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:02:06 user nova-compute[75203]:   <uuid>bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf</uuid>
Nov 28 19:02:06 user nova-compute[75203]:   <name>instance-00000028</name>
Nov 28 19:02:06 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:02:06 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:02:06 user nova-compute[75203]:   <metadata>
Nov 28 19:02:06 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:02:06 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:02:06 user nova-compute[75203]:       <nova:name>tempest-VolumesActionsTest-instance-1433799762</nova:name>
Nov 28 19:02:06 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:02:06</nova:creationTime>
Nov 28 19:02:06 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:02:06 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:02:06 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:02:06 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:02:06 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:02:06 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:02:06 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:02:06 user nova-compute[75203]:       <nova:owner>
Nov 28 19:02:06 user nova-compute[75203]:         <nova:user uuid="350de204ebf54cadb8a3c71049b7ff27">tempest-VolumesActionsTest-1987920535-project-member</nova:user>
Nov 28 19:02:06 user nova-compute[75203]:         <nova:project uuid="cca81c62e02c4570b890ea72f07dfe1d">tempest-VolumesActionsTest-1987920535</nova:project>
Nov 28 19:02:06 user nova-compute[75203]:       </nova:owner>
Nov 28 19:02:06 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 19:02:06 user nova-compute[75203]:       <nova:ports>
Nov 28 19:02:06 user nova-compute[75203]:         <nova:port uuid="fa3f5368-d7fa-4d01-b243-2434ec970091">
Nov 28 19:02:06 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 19:02:06 user nova-compute[75203]:         </nova:port>
Nov 28 19:02:06 user nova-compute[75203]:       </nova:ports>
Nov 28 19:02:06 user nova-compute[75203]:     </nova:instance>
Nov 28 19:02:06 user nova-compute[75203]:   </metadata>
Nov 28 19:02:06 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:02:06 user nova-compute[75203]:     <system>
Nov 28 19:02:06 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:02:06 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:02:06 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:02:06 user nova-compute[75203]:       <entry name="serial">bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf</entry>
Nov 28 19:02:06 user nova-compute[75203]:       <entry name="uuid">bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf</entry>
Nov 28 19:02:06 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:02:06 user nova-compute[75203]:     </system>
Nov 28 19:02:06 user nova-compute[75203]:   </sysinfo>
Nov 28 19:02:06 user nova-compute[75203]:   <os>
Nov 28 19:02:06 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:02:06 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:02:06 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:02:06 user nova-compute[75203]:   </os>
Nov 28 19:02:06 user nova-compute[75203]:   <features>
Nov 28 19:02:06 user nova-compute[75203]:     <acpi/>
Nov 28 19:02:06 user nova-compute[75203]:     <apic/>
Nov 28 19:02:06 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:02:06 user nova-compute[75203]:   </features>
Nov 28 19:02:06 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:02:06 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:02:06 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:02:06 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:02:06 user nova-compute[75203]:   </clock>
Nov 28 19:02:06 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:02:06 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:02:06 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:02:06 user nova-compute[75203]:   </cpu>
Nov 28 19:02:06 user nova-compute[75203]:   <devices>
Nov 28 19:02:06 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:02:06 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:02:06 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk"/>
Nov 28 19:02:06 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:02:06 user nova-compute[75203]:     </disk>
Nov 28 19:02:06 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:02:06 user nova-compute[75203]:       <mac address="fa:16:3e:33:66:b5"/>
Nov 28 19:02:06 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:02:06 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:02:06 user nova-compute[75203]:       <target dev="tapfa3f5368-d7"/>
Nov 28 19:02:06 user nova-compute[75203]:     </interface>
Nov 28 19:02:06 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:02:06 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/console.log" append="off"/>
Nov 28 19:02:06 user nova-compute[75203]:     </serial>
Nov 28 19:02:06 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:02:06 user nova-compute[75203]:     <video>
Nov 28 19:02:06 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:02:06 user nova-compute[75203]:     </video>
Nov 28 19:02:06 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:02:06 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:02:06 user nova-compute[75203]:     </rng>
Nov 28 19:02:06 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:02:06 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:02:06 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:02:06 user nova-compute[75203]:     </memballoon>
Nov 28 19:02:06 user nova-compute[75203]:   </devices>
Nov 28 19:02:06 user nova-compute[75203]: </domain>
Nov 28 19:02:06 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1433799762',display_name='tempest-VolumesActionsTest-instance-1433799762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1433799762',id=40,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cca81c62e02c4570b890ea72f07dfe1d',ramdisk_id='',reservation_id='r-xy3yf7ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1987920535',owner_user_name='tempest-VolumesActionsTest-1987920535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:02:05Z,user_data=None,user_id='350de204ebf54cadb8a3c71049b7ff27',uuid=bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converting VIF {"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa3f5368-d7fa-4d01-b243-2434ec970091,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3f5368-d7') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG os_vif [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa3f5368-d7fa-4d01-b243-2434ec970091,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3f5368-d7') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a684faaf-9982-5567-8069-e6eead40438b', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa3f5368-d7, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa3f5368-d7, col_values=(('qos', UUID('b6879107-9360-4f3c-a4b8-872cd20852aa')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa3f5368-d7, col_values=(('external_ids', {'iface-id': 'fa3f5368-d7fa-4d01-b243-2434ec970091', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:66:b5', 'vm-uuid': 'bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:07 user nova-compute[75203]: INFO os_vif [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa3f5368-d7fa-4d01-b243-2434ec970091,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3f5368-d7')
Nov 28 19:02:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:02:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] No VIF found with MAC fa:16:3e:33:66:b5, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:02:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Updated VIF entry in instance network info cache for port fa3f5368-d7fa-4d01-b243-2434ec970091. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:02:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Updating instance_info_cache with network_info: [{"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:02:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-874c8716-bc55-41eb-8ebf-a623902b0770 req-aa4d5d16-82b5-4ecd-9ee2-46408c2a201d service nova] Releasing lock "refresh_cache-bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0966217-dc07-4333-a1d5-1e96ad19418e req-d60154af-b805-4bb5-af46-d9ca7a728f28 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received event network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0966217-dc07-4333-a1d5-1e96ad19418e req-d60154af-b805-4bb5-af46-d9ca7a728f28 service nova] Acquiring lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0966217-dc07-4333-a1d5-1e96ad19418e req-d60154af-b805-4bb5-af46-d9ca7a728f28 service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f0966217-dc07-4333-a1d5-1e96ad19418e req-d60154af-b805-4bb5-af46-d9ca7a728f28 service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-f0966217-dc07-4333-a1d5-1e96ad19418e req-d60154af-b805-4bb5-af46-d9ca7a728f28 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] No waiting events found dispatching network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:02:08 user nova-compute[75203]: WARNING nova.compute.manager [req-f0966217-dc07-4333-a1d5-1e96ad19418e req-d60154af-b805-4bb5-af46-d9ca7a728f28 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received unexpected event network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 for instance with vm_state building and task_state spawning.
Nov 28 19:02:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:02:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Instance spawned successfully.
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-4904f591-1d44-4441-8737-36b9b80170c6 req-6cfba2d9-6be4-4425-af02-1f4a315a87a3 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received event network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4904f591-1d44-4441-8737-36b9b80170c6 req-6cfba2d9-6be4-4425-af02-1f4a315a87a3 service nova] Acquiring lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4904f591-1d44-4441-8737-36b9b80170c6 req-6cfba2d9-6be4-4425-af02-1f4a315a87a3 service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4904f591-1d44-4441-8737-36b9b80170c6 req-6cfba2d9-6be4-4425-af02-1f4a315a87a3 service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-4904f591-1d44-4441-8737-36b9b80170c6 req-6cfba2d9-6be4-4425-af02-1f4a315a87a3 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] No waiting events found dispatching network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:02:10 user nova-compute[75203]: WARNING nova.compute.manager [req-4904f591-1d44-4441-8737-36b9b80170c6 req-6cfba2d9-6be4-4425-af02-1f4a315a87a3 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received unexpected event network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 for instance with vm_state building and task_state spawning.
Nov 28 19:02:10 user nova-compute[75203]: INFO nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 28 19:02:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:02:10 user nova-compute[75203]: INFO nova.compute.manager [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Took 6.40 seconds to build instance.
Nov 28 19:02:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-52eacc65-b907-4e3d-acaa-b9c6a73e5f2f tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.512s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:02:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:02:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:02:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'info_cache' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.base [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.network.neutron [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:02:51 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance destroyed successfully.
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'resources' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.base [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG os_vif [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9646837-d0, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95303270-803b-43ac-88a7-12a8856818cd) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:51 user nova-compute[75203]: INFO os_vif [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0')
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Start _get_guest_xml network_info=[{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'numa_topology' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.base [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:02:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:02:51 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.base [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'pci_devices' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.objects.base [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:02:51 user nova-compute[75203]:   <uuid>17161f39-18b4-488b-871d-bc8e9e8faa00</uuid>
Nov 28 19:02:51 user nova-compute[75203]:   <name>instance-00000025</name>
Nov 28 19:02:51 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:02:51 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:02:51 user nova-compute[75203]:   <metadata>
Nov 28 19:02:51 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:02:51 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:02:51 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeTestJSON-server-1378465901</nova:name>
Nov 28 19:02:51 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:02:51</nova:creationTime>
Nov 28 19:02:51 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:02:51 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:02:51 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:02:51 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:02:51 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:02:51 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:02:51 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:02:51 user nova-compute[75203]:       <nova:owner>
Nov 28 19:02:51 user nova-compute[75203]:         <nova:user uuid="a95b00fbf38d4d9b852837c31a4cca68">tempest-AttachVolumeTestJSON-1450919923-project-member</nova:user>
Nov 28 19:02:51 user nova-compute[75203]:         <nova:project uuid="539e02b4366e46878557f18ea375a24a">tempest-AttachVolumeTestJSON-1450919923</nova:project>
Nov 28 19:02:51 user nova-compute[75203]:       </nova:owner>
Nov 28 19:02:51 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 19:02:51 user nova-compute[75203]:       <nova:ports>
Nov 28 19:02:51 user nova-compute[75203]:         <nova:port uuid="a9646837-d0bd-408a-9b59-b36ee39c6ab2">
Nov 28 19:02:51 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 19:02:51 user nova-compute[75203]:         </nova:port>
Nov 28 19:02:51 user nova-compute[75203]:       </nova:ports>
Nov 28 19:02:51 user nova-compute[75203]:     </nova:instance>
Nov 28 19:02:51 user nova-compute[75203]:   </metadata>
Nov 28 19:02:51 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:02:51 user nova-compute[75203]:     <system>
Nov 28 19:02:51 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:02:51 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:02:51 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:02:51 user nova-compute[75203]:       <entry name="serial">17161f39-18b4-488b-871d-bc8e9e8faa00</entry>
Nov 28 19:02:51 user nova-compute[75203]:       <entry name="uuid">17161f39-18b4-488b-871d-bc8e9e8faa00</entry>
Nov 28 19:02:51 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:02:51 user nova-compute[75203]:     </system>
Nov 28 19:02:51 user nova-compute[75203]:   </sysinfo>
Nov 28 19:02:51 user nova-compute[75203]:   <os>
Nov 28 19:02:51 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:02:51 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:02:51 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:02:51 user nova-compute[75203]:   </os>
Nov 28 19:02:51 user nova-compute[75203]:   <features>
Nov 28 19:02:51 user nova-compute[75203]:     <acpi/>
Nov 28 19:02:51 user nova-compute[75203]:     <apic/>
Nov 28 19:02:51 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:02:51 user nova-compute[75203]:   </features>
Nov 28 19:02:51 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:02:51 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:02:51 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:02:51 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:02:51 user nova-compute[75203]:   </clock>
Nov 28 19:02:51 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:02:51 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:02:51 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:02:51 user nova-compute[75203]:   </cpu>
Nov 28 19:02:51 user nova-compute[75203]:   <devices>
Nov 28 19:02:51 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:02:51 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:02:51 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk"/>
Nov 28 19:02:51 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:02:51 user nova-compute[75203]:     </disk>
Nov 28 19:02:51 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:02:51 user nova-compute[75203]:       <mac address="fa:16:3e:4f:07:14"/>
Nov 28 19:02:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:02:51 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:02:51 user nova-compute[75203]:       <target dev="tapa9646837-d0"/>
Nov 28 19:02:51 user nova-compute[75203]:     </interface>
Nov 28 19:02:51 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:02:51 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/console.log" append="off"/>
Nov 28 19:02:51 user nova-compute[75203]:     </serial>
Nov 28 19:02:51 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:02:51 user nova-compute[75203]:     <video>
Nov 28 19:02:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:02:51 user nova-compute[75203]:     </video>
Nov 28 19:02:51 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:02:51 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:02:51 user nova-compute[75203]:     </rng>
Nov 28 19:02:51 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:02:51 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:02:51 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:02:51 user nova-compute[75203]:     </memballoon>
Nov 28 19:02:51 user nova-compute[75203]:   </devices>
Nov 28 19:02:51 user nova-compute[75203]: </domain>
Nov 28 19:02:51 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:51 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'trusted_certs' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Cannot resize image /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'migration_context' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.objects.base [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Object Instance<17161f39-18b4-488b-871d-bc8e9e8faa00> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG os_vif [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95e3c0ce-1fa7-5bfc-abe6-2c5bd3c7fe69', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9646837-d0, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9646837-d0, col_values=(('qos', UUID('69f7aaf7-5802-4aa1-b15e-ada16baaccd3')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9646837-d0, col_values=(('external_ids', {'iface-id': 'a9646837-d0bd-408a-9b59-b36ee39c6ab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:07:14', 'vm-uuid': '17161f39-18b4-488b-871d-bc8e9e8faa00'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:02:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:52 user nova-compute[75203]: INFO os_vif [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0')
Nov 28 19:02:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5cd4caf-65cf-4051-97f2-6714a0c4beda req-e6d72cb5-3023-4698-87db-8c26ce84ab10 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5cd4caf-65cf-4051-97f2-6714a0c4beda req-e6d72cb5-3023-4698-87db-8c26ce84ab10 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5cd4caf-65cf-4051-97f2-6714a0c4beda req-e6d72cb5-3023-4698-87db-8c26ce84ab10 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a5cd4caf-65cf-4051-97f2-6714a0c4beda req-e6d72cb5-3023-4698-87db-8c26ce84ab10 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-a5cd4caf-65cf-4051-97f2-6714a0c4beda req-e6d72cb5-3023-4698-87db-8c26ce84ab10 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:02:54 user nova-compute[75203]: WARNING nova.compute.manager [req-a5cd4caf-65cf-4051-97f2-6714a0c4beda req-e6d72cb5-3023-4698-87db-8c26ce84ab10 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state stopped and task_state powering-on.
Nov 28 19:02:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:02:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance rebooted successfully.
Nov 28 19:02:56 user nova-compute[75203]: DEBUG nova.compute.manager [None req-5073c55c-e6cf-467b-8472-79a67049faff tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:02:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-829298c6-8587-4791-9f2d-677b6c28c20e req-2b50a02d-d951-49fa-a473-e03e40903d2f service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:02:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-829298c6-8587-4791-9f2d-677b6c28c20e req-2b50a02d-d951-49fa-a473-e03e40903d2f service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:02:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-829298c6-8587-4791-9f2d-677b6c28c20e req-2b50a02d-d951-49fa-a473-e03e40903d2f service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:02:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-829298c6-8587-4791-9f2d-677b6c28c20e req-2b50a02d-d951-49fa-a473-e03e40903d2f service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:02:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-829298c6-8587-4791-9f2d-677b6c28c20e req-2b50a02d-d951-49fa-a473-e03e40903d2f service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:02:56 user nova-compute[75203]: WARNING nova.compute.manager [req-829298c6-8587-4791-9f2d-677b6c28c20e req-2b50a02d-d951-49fa-a473-e03e40903d2f service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state active and task_state None.
Nov 28 19:02:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:02:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:02:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:03:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:03:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:00 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:03:00 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:03:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.038414001464844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:03:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:03:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:03:06 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:03:07 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [{"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:03:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-17161f39-18b4-488b-871d-bc8e9e8faa00" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:03:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:03:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:03:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:03:46 user nova-compute[75203]: INFO nova.compute.claims [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Claim successful on node user
Nov 28 19:03:46 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:03:46 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:03:46 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:03:47 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG nova.policy [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7545511dc1d4fa5ba723a110312fa4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7e2cd3ffb24750b81033db41a35a4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:03:47 user nova-compute[75203]: INFO nova.virt.block_device [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Booting with volume 1d907e48-caa5-4a73-9e63-bd353480e452 at /dev/vda
Nov 28 19:03:47 user nova-compute[75203]: DEBUG os_brick.utils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f88fb-d19d-438e-89a3-146e28d5496f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e55faf-6eb6-4663-8765-758352c9a07e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e8c510-78d0-4cc6-bcbb-62d52913ac08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c334c5d2-b663-432b-b785-6365bce6658b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:03:47 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:03:47 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb42966f-f762-4a3d-9523-b883471112af]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG os_brick.utils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating existing volume attachment record: d67f88f8-50f6-4968-8d02-bf3e93e9ad07 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:47 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Successfully created port: 214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Successfully updated port: 214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-changed-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing instance network info cache due to event network-changed-214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.network.neutron [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance network_info: |[{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:03:48 user nova-compute[75203]: DEBUG nova.network.neutron [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing network info cache for port 214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:03:49 user nova-compute[75203]: DEBUG nova.network.neutron [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updated VIF entry in instance network info cache for port 214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:03:49 user nova-compute[75203]: DEBUG nova.network.neutron [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:03:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe8d1a10-7677-4444-9016-d9a3fe8d6684 req-3b7440b7-49c3-4801-bb9d-62e39e21a64b service nova] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:03:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:03:54 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Creating image(s)
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Ensure instance console log exists: /opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Start _get_guest_xml network_info=[{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '325cbd77-1799-44f6-9b96-17f8a93b53b0', 'attached_at': '', 'detached_at': '', 'volume_id': '1d907e48-caa5-4a73-9e63-bd353480e452', 'serial': '1d907e48-caa5-4a73-9e63-bd353480e452'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'd67f88f8-50f6-4968-8d02-bf3e93e9ad07', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:03:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:03:54 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:03:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:03:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:03:54 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[14267cdc-0fe9-4182-a8d6-5bb71bb8274c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:03:54 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[230ba780-ae63-4d4e-95f6-5cd437df9512]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452] added
Nov 28 19:03:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d0011f-8846-46ae-b90c-4ce642fcb861]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06fba36-4c2a-4956-b6ba-78d26c58ca66]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JINpHSes {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JINpHSes" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270b958-5c90-4273-a8ee-76eac47e3169]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JINpHSes'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[760fcfe3-83e6-44dd-aca1-21783c856278]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[373f053c-e9e4-4e97-aec0-282d07bdbfaa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:03:54 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:03:54 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:03:54 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:03:54 user nova-compute[75203]: 
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91fff89-62a1-43ed-bbad-705e72007b63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]
Nov 28 19:03:54 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.
Nov 28 19:03:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf8c598-7dd8-4914-8502-7d1ba6294adb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa17593-9f19-482c-9b77-5d4da51ec60d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:03:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:03:54 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[104ffe99-d073-4557-ac29-736c2084af4f]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:03:54 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:55 user nova-compute[75203]: INFO nova.compute.manager [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Terminating instance
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.compute.manager [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-62275a8a-d343-43bd-990a-7319c9b39e62 req-f9a8502f-6450-414f-bfb4-b72c5dac0922 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received event network-vif-unplugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62275a8a-d343-43bd-990a-7319c9b39e62 req-f9a8502f-6450-414f-bfb4-b72c5dac0922 service nova] Acquiring lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62275a8a-d343-43bd-990a-7319c9b39e62 req-f9a8502f-6450-414f-bfb4-b72c5dac0922 service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-62275a8a-d343-43bd-990a-7319c9b39e62 req-f9a8502f-6450-414f-bfb4-b72c5dac0922 service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-62275a8a-d343-43bd-990a-7319c9b39e62 req-f9a8502f-6450-414f-bfb4-b72c5dac0922 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] No waiting events found dispatching network-vif-unplugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.compute.manager [req-62275a8a-d343-43bd-990a-7319c9b39e62 req-f9a8502f-6450-414f-bfb4-b72c5dac0922 service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received event network-vif-unplugged-fa3f5368-d7fa-4d01-b243-2434ec970091 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26262656164663531', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262656164663531', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385744915',display_name='tempest-TestShelveInstance-server-1385744915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385744915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRh4JdcBo385d0nD/g5oN45fbhwg49RMQ1/ZZbKjFeVJzI1vPMZVJrpqSwOy53Ov3kbOTl1+G8PRAmqvSqLiiibWbZXP30iMXyrQxGvsfw/Ds4FdTuaPGauJirY7UlGfw==',key_name='tempest-TestShelveInstance-1256305827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b7e2cd3ffb24750b81033db41a35a4d',ramdisk_id='',reservation_id='r-zal341xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-865744978',owner_user_name='tempest-TestShelveInstance-865744978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:03:47Z,user_data=None,user_id='c7545511dc1d4fa5ba723a110312fa4f',uuid=325cbd77-1799-44f6-9b96-17f8a93b53b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converting VIF {"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'pci_devices' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:03:55 user nova-compute[75203]:   <uuid>325cbd77-1799-44f6-9b96-17f8a93b53b0</uuid>
Nov 28 19:03:55 user nova-compute[75203]:   <name>instance-00000029</name>
Nov 28 19:03:55 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:03:55 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:03:55 user nova-compute[75203]:   <metadata>
Nov 28 19:03:55 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:03:55 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:03:55 user nova-compute[75203]:       <nova:name>tempest-TestShelveInstance-server-1385744915</nova:name>
Nov 28 19:03:55 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:03:54</nova:creationTime>
Nov 28 19:03:55 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:03:55 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:03:55 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:03:55 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:03:55 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:03:55 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:03:55 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:03:55 user nova-compute[75203]:       <nova:owner>
Nov 28 19:03:55 user nova-compute[75203]:         <nova:user uuid="c7545511dc1d4fa5ba723a110312fa4f">tempest-TestShelveInstance-865744978-project-member</nova:user>
Nov 28 19:03:55 user nova-compute[75203]:         <nova:project uuid="5b7e2cd3ffb24750b81033db41a35a4d">tempest-TestShelveInstance-865744978</nova:project>
Nov 28 19:03:55 user nova-compute[75203]:       </nova:owner>
Nov 28 19:03:55 user nova-compute[75203]:       <nova:ports>
Nov 28 19:03:55 user nova-compute[75203]:         <nova:port uuid="214e9746-a41c-4671-b7de-d89039d075af">
Nov 28 19:03:55 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 19:03:55 user nova-compute[75203]:         </nova:port>
Nov 28 19:03:55 user nova-compute[75203]:       </nova:ports>
Nov 28 19:03:55 user nova-compute[75203]:     </nova:instance>
Nov 28 19:03:55 user nova-compute[75203]:   </metadata>
Nov 28 19:03:55 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:03:55 user nova-compute[75203]:     <system>
Nov 28 19:03:55 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:03:55 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:03:55 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:03:55 user nova-compute[75203]:       <entry name="serial">325cbd77-1799-44f6-9b96-17f8a93b53b0</entry>
Nov 28 19:03:55 user nova-compute[75203]:       <entry name="uuid">325cbd77-1799-44f6-9b96-17f8a93b53b0</entry>
Nov 28 19:03:55 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:03:55 user nova-compute[75203]:     </system>
Nov 28 19:03:55 user nova-compute[75203]:   </sysinfo>
Nov 28 19:03:55 user nova-compute[75203]:   <os>
Nov 28 19:03:55 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:03:55 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:03:55 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:03:55 user nova-compute[75203]:   </os>
Nov 28 19:03:55 user nova-compute[75203]:   <features>
Nov 28 19:03:55 user nova-compute[75203]:     <acpi/>
Nov 28 19:03:55 user nova-compute[75203]:     <apic/>
Nov 28 19:03:55 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:03:55 user nova-compute[75203]:   </features>
Nov 28 19:03:55 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:03:55 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:03:55 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:03:55 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:03:55 user nova-compute[75203]:   </clock>
Nov 28 19:03:55 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:03:55 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:03:55 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:03:55 user nova-compute[75203]:   </cpu>
Nov 28 19:03:55 user nova-compute[75203]:   <devices>
Nov 28 19:03:55 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:03:55 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:03:55 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 19:03:55 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:03:55 user nova-compute[75203]:       <serial>1d907e48-caa5-4a73-9e63-bd353480e452</serial>
Nov 28 19:03:55 user nova-compute[75203]:     </disk>
Nov 28 19:03:55 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:03:55 user nova-compute[75203]:       <mac address="fa:16:3e:de:6e:1b"/>
Nov 28 19:03:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:03:55 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:03:55 user nova-compute[75203]:       <target dev="tap214e9746-a4"/>
Nov 28 19:03:55 user nova-compute[75203]:     </interface>
Nov 28 19:03:55 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:03:55 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0/console.log" append="off"/>
Nov 28 19:03:55 user nova-compute[75203]:     </serial>
Nov 28 19:03:55 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:03:55 user nova-compute[75203]:     <video>
Nov 28 19:03:55 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:03:55 user nova-compute[75203]:     </video>
Nov 28 19:03:55 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:03:55 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:03:55 user nova-compute[75203]:     </rng>
Nov 28 19:03:55 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:03:55 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:03:55 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:03:55 user nova-compute[75203]:     </memballoon>
Nov 28 19:03:55 user nova-compute[75203]:   </devices>
Nov 28 19:03:55 user nova-compute[75203]: </domain>
Nov 28 19:03:55 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385744915',display_name='tempest-TestShelveInstance-server-1385744915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385744915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRh4JdcBo385d0nD/g5oN45fbhwg49RMQ1/ZZbKjFeVJzI1vPMZVJrpqSwOy53Ov3kbOTl1+G8PRAmqvSqLiiibWbZXP30iMXyrQxGvsfw/Ds4FdTuaPGauJirY7UlGfw==',key_name='tempest-TestShelveInstance-1256305827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b7e2cd3ffb24750b81033db41a35a4d',ramdisk_id='',reservation_id='r-zal341xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-865744978',owner_user_name='tempest-TestShelveInstance-865744978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:03:47Z,user_data=None,user_id='c7545511dc1d4fa5ba723a110312fa4f',uuid=325cbd77-1799-44f6-9b96-17f8a93b53b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converting VIF {"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG os_vif [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36831dad-c6b0-58bb-b0ca-4c92828f21de', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap214e9746-a4, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap214e9746-a4, col_values=(('qos', UUID('b31519d4-a336-4ce9-9a1f-0e1547cd73de')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap214e9746-a4, col_values=(('external_ids', {'iface-id': '214e9746-a41c-4671-b7de-d89039d075af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:6e:1b', 'vm-uuid': '325cbd77-1799-44f6-9b96-17f8a93b53b0'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:55 user nova-compute[75203]: INFO os_vif [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4')
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:03:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] No VIF found with MAC fa:16:3e:de:6e:1b, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:03:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Instance destroyed successfully.
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.objects.instance [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lazy-loading 'resources' on Instance uuid bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1433799762',display_name='tempest-VolumesActionsTest-instance-1433799762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1433799762',id=40,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cca81c62e02c4570b890ea72f07dfe1d',ramdisk_id='',reservation_id='r-xy3yf7ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1987920535',owner_user_name='tempest-VolumesActionsTest-1987920535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:02:11Z,user_data=None,user_id='350de204ebf54cadb8a3c71049b7ff27',uuid=bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converting VIF {"id": "fa3f5368-d7fa-4d01-b243-2434ec970091", "address": "fa:16:3e:33:66:b5", "network": {"id": "cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-695184357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cca81c62e02c4570b890ea72f07dfe1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f5368-d7", "ovs_interfaceid": "fa3f5368-d7fa-4d01-b243-2434ec970091", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa3f5368-d7fa-4d01-b243-2434ec970091,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3f5368-d7') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG os_vif [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa3f5368-d7fa-4d01-b243-2434ec970091,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3f5368-d7') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa3f5368-d7, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6879107-9360-4f3c-a4b8-872cd20852aa) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:56 user nova-compute[75203]: INFO os_vif [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=fa3f5368-d7fa-4d01-b243-2434ec970091,network=Network(cc2452fc-ea82-4fe2-9f27-3ec7b76cd2c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa3f5368-d7')
Nov 28 19:03:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Deleting instance files /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf_del
Nov 28 19:03:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Deletion of /opt/stack/data/nova/instances/bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf_del complete
Nov 28 19:03:56 user nova-compute[75203]: INFO nova.compute.manager [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 19:03:56 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:03:56 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Took 0.39 seconds to deallocate network for instance.
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-8f87db24-79b4-44b4-ae61-b359237a3846 req-fe292eab-f25c-494f-9a91-ba93a95ce56d service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received event network-vif-deleted-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:03:56 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:57 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Deleted allocations for instance bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-01f4ac0e-5070-4291-a1ca-3925b47a6b0b tempest-VolumesActionsTest-1987920535 tempest-VolumesActionsTest-1987920535-project-member] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received event network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] Acquiring lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] Lock "bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] No waiting events found dispatching network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:03:57 user nova-compute[75203]: WARNING nova.compute.manager [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] [instance: bca3e4ce-3789-4cfd-ae2d-94e3b9ba3dcf] Received unexpected event network-vif-plugged-fa3f5368-d7fa-4d01-b243-2434ec970091 for instance with vm_state deleted and task_state None.
Nov 28 19:03:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG nova.compute.manager [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:03:57 user nova-compute[75203]: WARNING nova.compute.manager [req-bc51953d-afc7-4605-ace7-99215eea785c req-6a4ba308-8823-4125-96f6-55cdf67429cb service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state building and task_state spawning.
Nov 28 19:03:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:03:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:03:59 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance spawned successfully.
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:03:59 user nova-compute[75203]: INFO nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 28 19:03:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:03:59 user nova-compute[75203]: INFO nova.compute.manager [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Took 13.02 seconds to build instance.
Nov 28 19:03:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-7f81ed93-202e-456d-92cb-aad70a552775 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.126s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:03:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-2daa728b-ecc5-41a1-b807-9f274a310ba7 req-427bc16a-5d57-47aa-ad5a-a95df498cc4e service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:04:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2daa728b-ecc5-41a1-b807-9f274a310ba7 req-427bc16a-5d57-47aa-ad5a-a95df498cc4e service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2daa728b-ecc5-41a1-b807-9f274a310ba7 req-427bc16a-5d57-47aa-ad5a-a95df498cc4e service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2daa728b-ecc5-41a1-b807-9f274a310ba7 req-427bc16a-5d57-47aa-ad5a-a95df498cc4e service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-2daa728b-ecc5-41a1-b807-9f274a310ba7 req-427bc16a-5d57-47aa-ad5a-a95df498cc4e service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:04:00 user nova-compute[75203]: WARNING nova.compute.manager [req-2daa728b-ecc5-41a1-b807-9f274a310ba7 req-427bc16a-5d57-47aa-ad5a-a95df498cc4e service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state None.
Nov 28 19:04:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:00 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:04:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:04:02 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:04:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.060928344726562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 325cbd77-1799-44f6-9b96-17f8a93b53b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:04:02 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:04:03 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:04:03 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:04:03 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:04:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:04:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:04:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:04:10 user nova-compute[75203]: INFO nova.compute.claims [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Claim successful on node user
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:04:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.policy [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5327ccb36afb440396c9228baa2fb85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478ac7f43b8c49abb6b7497869905748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:04:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Creating image(s)
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "/opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "/opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "/opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "34143111c5ea11a0e2dac5fbbfe487001d4babe1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "34143111c5ea11a0e2dac5fbbfe487001d4babe1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Successfully created port: 31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG nova.virt.images [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] f01c7807-d9ab-44a2-ac4b-9864fe5f51ac was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.part /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.part /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.converted" returned: 0 in 0.279s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "34143111c5ea11a0e2dac5fbbfe487001d4babe1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.115s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Successfully updated port: 31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing instance network info cache due to event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "34143111c5ea11a0e2dac5fbbfe487001d4babe1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "34143111c5ea11a0e2dac5fbbfe487001d4babe1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json" returned: 0 in 0.196s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1,backing_fmt=raw /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1,backing_fmt=raw /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk 1073741824" returned: 0 in 0.054s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "34143111c5ea11a0e2dac5fbbfe487001d4babe1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance network_info: |[{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Cannot resize image /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Ensure instance console log exists: /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Start _get_guest_xml network_info=[{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T19:04:08Z,direct_url=<?>,disk_format='qcow2',id=f01c7807-d9ab-44a2-ac4b-9864fe5f51ac,min_disk=0,min_ram=0,name='tempest-scenario-img--1792589039',owner='478ac7f43b8c49abb6b7497869905748',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T19:04:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'f01c7807-d9ab-44a2-ac4b-9864fe5f51ac'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:04:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:04:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T19:04:08Z,direct_url=<?>,disk_format='qcow2',id=f01c7807-d9ab-44a2-ac4b-9864fe5f51ac,min_disk=0,min_ram=0,name='tempest-scenario-img--1792589039',owner='478ac7f43b8c49abb6b7497869905748',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T19:04:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-616332968',display_name='tempest-TestMinimumBasicScenario-server-616332968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-616332968',id=42,image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFOCpnB2b6DnSfoXsaqVLA3cdnNrL+wCW0k48+vaNwoDvNtXFSbiohAOXMOFTW/XAQNFDWcEIAJy707gWTctIFdyTpGufAZqZjbkBC+g9IqZkoif0H95gTL4udJNIII3w==',key_name='tempest-TestMinimumBasicScenario-1036669470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-y5h8vpmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:04:11Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=8386807e-76ec-46b2-90e7-8391806f89c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'pci_devices' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:04:12 user nova-compute[75203]:   <uuid>8386807e-76ec-46b2-90e7-8391806f89c8</uuid>
Nov 28 19:04:12 user nova-compute[75203]:   <name>instance-0000002a</name>
Nov 28 19:04:12 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:04:12 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:04:12 user nova-compute[75203]:   <metadata>
Nov 28 19:04:12 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:04:12 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:04:12 user nova-compute[75203]:       <nova:name>tempest-TestMinimumBasicScenario-server-616332968</nova:name>
Nov 28 19:04:12 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:04:12</nova:creationTime>
Nov 28 19:04:12 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:04:12 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:04:12 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:04:12 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:04:12 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:04:12 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:04:12 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:04:12 user nova-compute[75203]:       <nova:owner>
Nov 28 19:04:12 user nova-compute[75203]:         <nova:user uuid="5327ccb36afb440396c9228baa2fb85d">tempest-TestMinimumBasicScenario-710384277-project-member</nova:user>
Nov 28 19:04:12 user nova-compute[75203]:         <nova:project uuid="478ac7f43b8c49abb6b7497869905748">tempest-TestMinimumBasicScenario-710384277</nova:project>
Nov 28 19:04:12 user nova-compute[75203]:       </nova:owner>
Nov 28 19:04:12 user nova-compute[75203]:       <nova:root type="image" uuid="f01c7807-d9ab-44a2-ac4b-9864fe5f51ac"/>
Nov 28 19:04:12 user nova-compute[75203]:       <nova:ports>
Nov 28 19:04:12 user nova-compute[75203]:         <nova:port uuid="31aa148f-3bea-4cc9-98f1-2e21a160c25c">
Nov 28 19:04:12 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 19:04:12 user nova-compute[75203]:         </nova:port>
Nov 28 19:04:12 user nova-compute[75203]:       </nova:ports>
Nov 28 19:04:12 user nova-compute[75203]:     </nova:instance>
Nov 28 19:04:12 user nova-compute[75203]:   </metadata>
Nov 28 19:04:12 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:04:12 user nova-compute[75203]:     <system>
Nov 28 19:04:12 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:04:12 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:04:12 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:04:12 user nova-compute[75203]:       <entry name="serial">8386807e-76ec-46b2-90e7-8391806f89c8</entry>
Nov 28 19:04:12 user nova-compute[75203]:       <entry name="uuid">8386807e-76ec-46b2-90e7-8391806f89c8</entry>
Nov 28 19:04:12 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:04:12 user nova-compute[75203]:     </system>
Nov 28 19:04:12 user nova-compute[75203]:   </sysinfo>
Nov 28 19:04:12 user nova-compute[75203]:   <os>
Nov 28 19:04:12 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:04:12 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:04:12 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:04:12 user nova-compute[75203]:   </os>
Nov 28 19:04:12 user nova-compute[75203]:   <features>
Nov 28 19:04:12 user nova-compute[75203]:     <acpi/>
Nov 28 19:04:12 user nova-compute[75203]:     <apic/>
Nov 28 19:04:12 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:04:12 user nova-compute[75203]:   </features>
Nov 28 19:04:12 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:04:12 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:04:12 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:04:12 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:04:12 user nova-compute[75203]:   </clock>
Nov 28 19:04:12 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:04:12 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:04:12 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:04:12 user nova-compute[75203]:   </cpu>
Nov 28 19:04:12 user nova-compute[75203]:   <devices>
Nov 28 19:04:12 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:04:12 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:04:12 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk"/>
Nov 28 19:04:12 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:04:12 user nova-compute[75203]:     </disk>
Nov 28 19:04:12 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:04:12 user nova-compute[75203]:       <mac address="fa:16:3e:c6:0e:27"/>
Nov 28 19:04:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:04:12 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:04:12 user nova-compute[75203]:       <target dev="tap31aa148f-3b"/>
Nov 28 19:04:12 user nova-compute[75203]:     </interface>
Nov 28 19:04:12 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:04:12 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/console.log" append="off"/>
Nov 28 19:04:12 user nova-compute[75203]:     </serial>
Nov 28 19:04:12 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:04:12 user nova-compute[75203]:     <video>
Nov 28 19:04:12 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:04:12 user nova-compute[75203]:     </video>
Nov 28 19:04:12 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:04:12 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:04:12 user nova-compute[75203]:     </rng>
Nov 28 19:04:12 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:04:12 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:04:12 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:04:12 user nova-compute[75203]:     </memballoon>
Nov 28 19:04:12 user nova-compute[75203]:   </devices>
Nov 28 19:04:12 user nova-compute[75203]: </domain>
Nov 28 19:04:12 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-616332968',display_name='tempest-TestMinimumBasicScenario-server-616332968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-616332968',id=42,image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFOCpnB2b6DnSfoXsaqVLA3cdnNrL+wCW0k48+vaNwoDvNtXFSbiohAOXMOFTW/XAQNFDWcEIAJy707gWTctIFdyTpGufAZqZjbkBC+g9IqZkoif0H95gTL4udJNIII3w==',key_name='tempest-TestMinimumBasicScenario-1036669470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-y5h8vpmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:04:11Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=8386807e-76ec-46b2-90e7-8391806f89c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG os_vif [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updated VIF entry in instance network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c4ca895-ed1d-5606-92f1-4778f5839167', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9e2f7e92-87c6-49e4-b6ef-bd751d3935cd req-08a20e0e-7846-4325-872d-2568ac2f2c54 service nova] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31aa148f-3b, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31aa148f-3b, col_values=(('qos', UUID('1b0ddadc-d582-40bc-bee3-1057fb3bb7da')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31aa148f-3b, col_values=(('external_ids', {'iface-id': '31aa148f-3bea-4cc9-98f1-2e21a160c25c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:0e:27', 'vm-uuid': '8386807e-76ec-46b2-90e7-8391806f89c8'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:04:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:12 user nova-compute[75203]: INFO os_vif [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b')
Nov 28 19:04:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:04:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No VIF found with MAC fa:16:3e:c6:0e:27, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:04:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe3f8ff8-41ff-41d6-9840-b22cd4734503 req-daa669e9-b7c7-4239-99fb-9b562755547a service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe3f8ff8-41ff-41d6-9840-b22cd4734503 req-daa669e9-b7c7-4239-99fb-9b562755547a service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe3f8ff8-41ff-41d6-9840-b22cd4734503 req-daa669e9-b7c7-4239-99fb-9b562755547a service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fe3f8ff8-41ff-41d6-9840-b22cd4734503 req-daa669e9-b7c7-4239-99fb-9b562755547a service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-fe3f8ff8-41ff-41d6-9840-b22cd4734503 req-daa669e9-b7c7-4239-99fb-9b562755547a service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:04:14 user nova-compute[75203]: WARNING nova.compute.manager [req-fe3f8ff8-41ff-41d6-9840-b22cd4734503 req-daa669e9-b7c7-4239-99fb-9b562755547a service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received unexpected event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with vm_state building and task_state spawning.
Nov 28 19:04:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:04:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance spawned successfully.
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:04:16 user nova-compute[75203]: INFO nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-6face345-cec1-4335-8f7b-7ece9d9eb0b9 req-8e4115eb-3bc8-4eff-9576-587c774cadf0 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6face345-cec1-4335-8f7b-7ece9d9eb0b9 req-8e4115eb-3bc8-4eff-9576-587c774cadf0 service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6face345-cec1-4335-8f7b-7ece9d9eb0b9 req-8e4115eb-3bc8-4eff-9576-587c774cadf0 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-6face345-cec1-4335-8f7b-7ece9d9eb0b9 req-8e4115eb-3bc8-4eff-9576-587c774cadf0 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-6face345-cec1-4335-8f7b-7ece9d9eb0b9 req-8e4115eb-3bc8-4eff-9576-587c774cadf0 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:04:16 user nova-compute[75203]: WARNING nova.compute.manager [req-6face345-cec1-4335-8f7b-7ece9d9eb0b9 req-8e4115eb-3bc8-4eff-9576-587c774cadf0 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received unexpected event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with vm_state active and task_state None.
Nov 28 19:04:16 user nova-compute[75203]: INFO nova.compute.manager [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Took 6.37 seconds to build instance.
Nov 28 19:04:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d1c5ca7e-e420-4167-a5c5-8cc42bd49383 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.460s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:42 user nova-compute[75203]: INFO nova.compute.manager [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Terminating instance
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-2eff633e-d2d7-401d-8cd3-706c2b808013 req-73e3e134-79e0-4518-95b5-3ddb6ba73e7c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2eff633e-d2d7-401d-8cd3-706c2b808013 req-73e3e134-79e0-4518-95b5-3ddb6ba73e7c service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2eff633e-d2d7-401d-8cd3-706c2b808013 req-73e3e134-79e0-4518-95b5-3ddb6ba73e7c service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2eff633e-d2d7-401d-8cd3-706c2b808013 req-73e3e134-79e0-4518-95b5-3ddb6ba73e7c service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-2eff633e-d2d7-401d-8cd3-706c2b808013 req-73e3e134-79e0-4518-95b5-3ddb6ba73e7c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-2eff633e-d2d7-401d-8cd3-706c2b808013 req-73e3e134-79e0-4518-95b5-3ddb6ba73e7c service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-unplugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Instance destroyed successfully.
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.objects.instance [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'resources' on Instance uuid 17161f39-18b4-488b-871d-bc8e9e8faa00 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T18:54:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1378465901',display_name='tempest-AttachVolumeTestJSON-server-1378465901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1378465901',id=37,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxfgOBjjGvk0rg0shuqBo0wbirTp5UEm2AZdBd5QuJ4/flHuCkfJFLX03IUeTjFqT9HsikUsRiaFaI64JhnAM/2vBaV+YXQnFNUMfRggScxzrjMUHIf0DYuQs0H0YMkhw==',key_name='tempest-keypair-1533699564',keypairs=<?>,launch_index=0,launched_at=2023-11-28T18:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-odvevfom',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=17161f39-18b4-488b-871d-bc8e9e8faa00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "address": "fa:16:3e:4f:07:14", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9646837-d0", "ovs_interfaceid": "a9646837-d0bd-408a-9b59-b36ee39c6ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG os_vif [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9646837-d0, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69f7aaf7-5802-4aa1-b15e-ada16baaccd3) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:04:42 user nova-compute[75203]: INFO os_vif [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:07:14,bridge_name='br-int',has_traffic_filtering=True,id=a9646837-d0bd-408a-9b59-b36ee39c6ab2,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9646837-d0')
Nov 28 19:04:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Deleting instance files /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00_del
Nov 28 19:04:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Deletion of /opt/stack/data/nova/instances/17161f39-18b4-488b-871d-bc8e9e8faa00_del complete
Nov 28 19:04:42 user nova-compute[75203]: INFO nova.compute.manager [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 28 19:04:42 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:04:42 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:04:43 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Took 0.66 seconds to deallocate network for instance.
Nov 28 19:04:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-4ae55fb9-1144-42dc-9c4a-6fb1da073e37 req-f8c68983-095b-4e72-a2ac-1e13109c0d4d service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-deleted-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:04:43 user nova-compute[75203]: INFO nova.compute.manager [req-4ae55fb9-1144-42dc-9c4a-6fb1da073e37 req-f8c68983-095b-4e72-a2ac-1e13109c0d4d service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Neutron deleted interface a9646837-d0bd-408a-9b59-b36ee39c6ab2; detaching it from the instance and deleting it from the info cache
Nov 28 19:04:43 user nova-compute[75203]: DEBUG nova.network.neutron [req-4ae55fb9-1144-42dc-9c4a-6fb1da073e37 req-f8c68983-095b-4e72-a2ac-1e13109c0d4d service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG nova.compute.manager [req-4ae55fb9-1144-42dc-9c4a-6fb1da073e37 req-f8c68983-095b-4e72-a2ac-1e13109c0d4d service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Detach interface failed, port_id=a9646837-d0bd-408a-9b59-b36ee39c6ab2, reason: Instance 17161f39-18b4-488b-871d-bc8e9e8faa00 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:43 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Deleted allocations for instance 17161f39-18b4-488b-871d-bc8e9e8faa00
Nov 28 19:04:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-235a4d10-adec-4342-91d6-dd2a742236ec tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.666s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-63367abb-0a86-4817-a7e9-ff5cbaaea700 req-3b7b7a8c-d9a9-4c3d-a270-226c214c4271 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:04:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-63367abb-0a86-4817-a7e9-ff5cbaaea700 req-3b7b7a8c-d9a9-4c3d-a270-226c214c4271 service nova] Acquiring lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:04:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-63367abb-0a86-4817-a7e9-ff5cbaaea700 req-3b7b7a8c-d9a9-4c3d-a270-226c214c4271 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:04:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-63367abb-0a86-4817-a7e9-ff5cbaaea700 req-3b7b7a8c-d9a9-4c3d-a270-226c214c4271 service nova] Lock "17161f39-18b4-488b-871d-bc8e9e8faa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:04:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-63367abb-0a86-4817-a7e9-ff5cbaaea700 req-3b7b7a8c-d9a9-4c3d-a270-226c214c4271 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] No waiting events found dispatching network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:04:44 user nova-compute[75203]: WARNING nova.compute.manager [req-63367abb-0a86-4817-a7e9-ff5cbaaea700 req-3b7b7a8c-d9a9-4c3d-a270-226c214c4271 service nova] [instance: 17161f39-18b4-488b-871d-bc8e9e8faa00] Received unexpected event network-vif-plugged-a9646837-d0bd-408a-9b59-b36ee39c6ab2 for instance with vm_state deleted and task_state None.
Nov 28 19:04:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:04:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:02 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:05:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:05:03 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:03 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:05:03 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:05:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:04 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:05:04 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:05:04 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=24.58517837524414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 325cbd77-1799-44f6-9b96-17f8a93b53b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8386807e-76ec-46b2-90e7-8391806f89c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:05:04 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:05:05 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:05:05 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:05:05 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:05:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:05:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:05:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:05:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:05:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:05:09 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:05:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:05:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:05:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:05:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:05:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:35 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:35 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:05:35 user nova-compute[75203]: INFO nova.compute.claims [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Claim successful on node user
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:05:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.policy [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a95b00fbf38d4d9b852837c31a4cca68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539e02b4366e46878557f18ea375a24a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:05:36 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Creating image(s)
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "/opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "/opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "/opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk 1073741824" returned: 0 in 0.057s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 19:05:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Cannot resize image /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Ensure instance console log exists: /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Successfully created port: 84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Successfully updated port: 84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquired lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-changed-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.compute.manager [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Refreshing instance network info cache due to event network-changed-84839b11-70ab-47e4-b2d2-5e3b170ac7ec. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] Acquiring lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:05:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updating instance_info_cache with network_info: [{"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Releasing lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Instance network_info: |[{"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] Acquired lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Refreshing network info cache for port 84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Start _get_guest_xml network_info=[{"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:05:38 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:05:38 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1933108232',display_name='tempest-AttachVolumeTestJSON-server-1933108232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1933108232',id=43,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtwcCu+y8G/Za8cg0XRSRaVvGphzhPN2cW0GqJq/wmnUSsRwI7XwsVoNmCqG5hqsBNP2NOiEiZVu7JGAKNY29zMBEA+U7ANekPgjY0ncjSjl9UB14mFI08uRlgcjNlbHw==',key_name='tempest-keypair-536936720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-1x1u7hbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:05:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=9de853a9-19ac-44d9-a9bc-768d6261c235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=84839b11-70ab-47e4-b2d2-5e3b170ac7ec,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84839b11-70') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.objects.instance [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'pci_devices' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:05:38 user nova-compute[75203]:   <uuid>9de853a9-19ac-44d9-a9bc-768d6261c235</uuid>
Nov 28 19:05:38 user nova-compute[75203]:   <name>instance-0000002b</name>
Nov 28 19:05:38 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:05:38 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:05:38 user nova-compute[75203]:   <metadata>
Nov 28 19:05:38 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:05:38 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:05:38 user nova-compute[75203]:       <nova:name>tempest-AttachVolumeTestJSON-server-1933108232</nova:name>
Nov 28 19:05:38 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:05:38</nova:creationTime>
Nov 28 19:05:38 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:05:38 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:05:38 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:05:38 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:05:38 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:05:38 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:05:38 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:05:38 user nova-compute[75203]:       <nova:owner>
Nov 28 19:05:38 user nova-compute[75203]:         <nova:user uuid="a95b00fbf38d4d9b852837c31a4cca68">tempest-AttachVolumeTestJSON-1450919923-project-member</nova:user>
Nov 28 19:05:38 user nova-compute[75203]:         <nova:project uuid="539e02b4366e46878557f18ea375a24a">tempest-AttachVolumeTestJSON-1450919923</nova:project>
Nov 28 19:05:38 user nova-compute[75203]:       </nova:owner>
Nov 28 19:05:38 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 19:05:38 user nova-compute[75203]:       <nova:ports>
Nov 28 19:05:38 user nova-compute[75203]:         <nova:port uuid="84839b11-70ab-47e4-b2d2-5e3b170ac7ec">
Nov 28 19:05:38 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 28 19:05:38 user nova-compute[75203]:         </nova:port>
Nov 28 19:05:38 user nova-compute[75203]:       </nova:ports>
Nov 28 19:05:38 user nova-compute[75203]:     </nova:instance>
Nov 28 19:05:38 user nova-compute[75203]:   </metadata>
Nov 28 19:05:38 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:05:38 user nova-compute[75203]:     <system>
Nov 28 19:05:38 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:05:38 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:05:38 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:05:38 user nova-compute[75203]:       <entry name="serial">9de853a9-19ac-44d9-a9bc-768d6261c235</entry>
Nov 28 19:05:38 user nova-compute[75203]:       <entry name="uuid">9de853a9-19ac-44d9-a9bc-768d6261c235</entry>
Nov 28 19:05:38 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:05:38 user nova-compute[75203]:     </system>
Nov 28 19:05:38 user nova-compute[75203]:   </sysinfo>
Nov 28 19:05:38 user nova-compute[75203]:   <os>
Nov 28 19:05:38 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:05:38 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:05:38 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:05:38 user nova-compute[75203]:   </os>
Nov 28 19:05:38 user nova-compute[75203]:   <features>
Nov 28 19:05:38 user nova-compute[75203]:     <acpi/>
Nov 28 19:05:38 user nova-compute[75203]:     <apic/>
Nov 28 19:05:38 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:05:38 user nova-compute[75203]:   </features>
Nov 28 19:05:38 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:05:38 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:05:38 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:05:38 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:05:38 user nova-compute[75203]:   </clock>
Nov 28 19:05:38 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:05:38 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:05:38 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:05:38 user nova-compute[75203]:   </cpu>
Nov 28 19:05:38 user nova-compute[75203]:   <devices>
Nov 28 19:05:38 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:05:38 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:05:38 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk"/>
Nov 28 19:05:38 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:05:38 user nova-compute[75203]:     </disk>
Nov 28 19:05:38 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:05:38 user nova-compute[75203]:       <mac address="fa:16:3e:10:f2:a6"/>
Nov 28 19:05:38 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:05:38 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:05:38 user nova-compute[75203]:       <target dev="tap84839b11-70"/>
Nov 28 19:05:38 user nova-compute[75203]:     </interface>
Nov 28 19:05:38 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:05:38 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/console.log" append="off"/>
Nov 28 19:05:38 user nova-compute[75203]:     </serial>
Nov 28 19:05:38 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:05:38 user nova-compute[75203]:     <video>
Nov 28 19:05:38 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:05:38 user nova-compute[75203]:     </video>
Nov 28 19:05:38 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:05:38 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:05:38 user nova-compute[75203]:     </rng>
Nov 28 19:05:38 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:05:38 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:05:38 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:05:38 user nova-compute[75203]:     </memballoon>
Nov 28 19:05:38 user nova-compute[75203]:   </devices>
Nov 28 19:05:38 user nova-compute[75203]: </domain>
Nov 28 19:05:38 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1933108232',display_name='tempest-AttachVolumeTestJSON-server-1933108232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1933108232',id=43,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtwcCu+y8G/Za8cg0XRSRaVvGphzhPN2cW0GqJq/wmnUSsRwI7XwsVoNmCqG5hqsBNP2NOiEiZVu7JGAKNY29zMBEA+U7ANekPgjY0ncjSjl9UB14mFI08uRlgcjNlbHw==',key_name='tempest-keypair-536936720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-1x1u7hbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:05:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=9de853a9-19ac-44d9-a9bc-768d6261c235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=84839b11-70ab-47e4-b2d2-5e3b170ac7ec,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84839b11-70') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG os_vif [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=84839b11-70ab-47e4-b2d2-5e3b170ac7ec,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84839b11-70') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae4e1e42-c0dc-570c-9a06-60af87419af0', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84839b11-70, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84839b11-70, col_values=(('qos', UUID('ba6408a6-5625-451c-a78c-8bfc1743a78d')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84839b11-70, col_values=(('external_ids', {'iface-id': '84839b11-70ab-47e4-b2d2-5e3b170ac7ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:f2:a6', 'vm-uuid': '9de853a9-19ac-44d9-a9bc-768d6261c235'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:38 user nova-compute[75203]: INFO os_vif [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=84839b11-70ab-47e4-b2d2-5e3b170ac7ec,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84839b11-70')
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No VIF found with MAC fa:16:3e:10:f2:a6, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-changed-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing instance network info cache due to event network-changed-214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing network info cache for port 214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updated VIF entry in instance network info cache for port 84839b11-70ab-47e4-b2d2-5e3b170ac7ec. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updating instance_info_cache with network_info: [{"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-674512db-9289-46b8-a8e3-ac3ae36b0dfb req-412df025-27d6-478c-bc19-4690b1367569 service nova] Releasing lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:05:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updated VIF entry in instance network info cache for port 214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-bd3be920-f76b-424c-9771-9fe4bf5df043 req-5f09d843-8eae-4d8f-add6-e95938a5bc1c service nova] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:39 user nova-compute[75203]: INFO nova.compute.manager [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Shelve offloading
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-94778f33-fcd0-4d7d-a5df-33e480f92e2e req-547c8049-097a-4513-9d68-3a755f63d878 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-94778f33-fcd0-4d7d-a5df-33e480f92e2e req-547c8049-097a-4513-9d68-3a755f63d878 service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-94778f33-fcd0-4d7d-a5df-33e480f92e2e req-547c8049-097a-4513-9d68-3a755f63d878 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-94778f33-fcd0-4d7d-a5df-33e480f92e2e req-547c8049-097a-4513-9d68-3a755f63d878 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:39 user nova-compute[75203]: DEBUG nova.compute.manager [req-94778f33-fcd0-4d7d-a5df-33e480f92e2e req-547c8049-097a-4513-9d68-3a755f63d878 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:39 user nova-compute[75203]: WARNING nova.compute.manager [req-94778f33-fcd0-4d7d-a5df-33e480f92e2e req-547c8049-097a-4513-9d68-3a755f63d878 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received unexpected event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with vm_state building and task_state spawning.
Nov 28 19:05:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:40 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance destroyed successfully.
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:40 user nova-compute[75203]: WARNING nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state shelving.
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:40 user nova-compute[75203]: WARNING nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state shelving.
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:40 user nova-compute[75203]: WARNING nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state shelving.
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:40 user nova-compute[75203]: WARNING nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state shelving.
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:40 user nova-compute[75203]: WARNING nova.compute.manager [req-97053eda-1026-45c8-8f0d-b22241f0ca20 req-8eaf64db-3f7a-4fda-9dee-77fe6f919ac8 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state shelving.
Nov 28 19:05:40 user nova-compute[75203]: DEBUG nova.network.neutron [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:05:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:05:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance destroyed successfully.
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'resources' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385744915',display_name='tempest-TestShelveInstance-server-1385744915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385744915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRh4JdcBo385d0nD/g5oN45fbhwg49RMQ1/ZZbKjFeVJzI1vPMZVJrpqSwOy53Ov3kbOTl1+G8PRAmqvSqLiiibWbZXP30iMXyrQxGvsfw/Ds4FdTuaPGauJirY7UlGfw==',key_name='tempest-TestShelveInstance-1256305827',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b7e2cd3ffb24750b81033db41a35a4d',ramdisk_id='',reservation_id='r-zal341xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-865744978',owner_user_name='tempest-TestShelveInstance-865744978-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:04:00Z,user_data=None,user_id='c7545511dc1d4fa5ba723a110312fa4f',uuid=325cbd77-1799-44f6-9b96-17f8a93b53b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converting VIF {"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_vif [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap214e9746-a4, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b31519d4-a336-4ce9-9a1f-0e1547cd73de) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:05:41 user nova-compute[75203]: INFO os_vif [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4')
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:05:41 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc22c176-6d64-4ed6-b25a-9338fbaece06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:05:41 user nova-compute[75203]: No targets found.
Nov 28 19:05:41 user nova-compute[75203]: iSNS:
Nov 28 19:05:41 user nova-compute[75203]: No targets found.
Nov 28 19:05:41 user nova-compute[75203]: STATIC:
Nov 28 19:05:41 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452
Nov 28 19:05:41 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:05:41 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:05:41 user nova-compute[75203]: FIRMWARE:
Nov 28 19:05:41 user nova-compute[75203]: No targets found.
Nov 28 19:05:41 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:05:41 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:05:41 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ab18cc-0ba0-4e88-bc59-4053157fa0e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4916bf2-5cd0-447e-945a-c9aa26eb5f09]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:05:41 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:05:41 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f076c7f4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7671637d-c22a-4429-8c78-43b22d9467e1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3127d7fa-84be-4daf-b5a7-eb6fd4a427c2]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dbea10-2a9e-40de-89d8-9b35d4510e49]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[36148416-7a25-4036-9ea0-742156ff78e5]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd8006-209b-4c0b-b3f6-a6f827f4dfb5]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0683dc-f940-4d43-9cf6-d81e03567387]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]
Nov 28 19:05:41 user nova-compute[75203]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.
Nov 28 19:05:41 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd1f650-8f73-42f1-a121-9c57146190fd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] <== disconnect_volume: return (280ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:05:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Deleting instance files /opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0_del
Nov 28 19:05:41 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Deletion of /opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0_del complete
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:41 user nova-compute[75203]: WARNING nova.compute.manager [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received unexpected event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with vm_state building and task_state spawning.
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-changed-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.compute.manager [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing instance network info cache due to event network-changed-214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:05:41 user nova-compute[75203]: DEBUG nova.network.neutron [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing network info cache for port 214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:05:42 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Instance spawned successfully.
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:05:42 user nova-compute[75203]: INFO nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updated VIF entry in instance network info cache for port 214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.network.neutron [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": null, "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap214e9746-a4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9ab8d369-473d-4e03-8b2a-540889d22ee1 req-798c5d84-e20c-41cb-b925-8d72e67746f7 service nova] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:05:42 user nova-compute[75203]: INFO nova.compute.manager [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Took 6.61 seconds to build instance.
Nov 28 19:05:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-cabf3f8e-bce1-4a17-b710-d2de37db9e66 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.701s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-7d7954dd-a634-4e5e-b1c0-937b3c4a7983 req-59726e71-ed09-40ce-b617-168ce8fab5a0 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7d7954dd-a634-4e5e-b1c0-937b3c4a7983 req-59726e71-ed09-40ce-b617-168ce8fab5a0 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7d7954dd-a634-4e5e-b1c0-937b3c4a7983 req-59726e71-ed09-40ce-b617-168ce8fab5a0 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7d7954dd-a634-4e5e-b1c0-937b3c4a7983 req-59726e71-ed09-40ce-b617-168ce8fab5a0 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-7d7954dd-a634-4e5e-b1c0-937b3c4a7983 req-59726e71-ed09-40ce-b617-168ce8fab5a0 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:05:42 user nova-compute[75203]: WARNING nova.compute.manager [req-7d7954dd-a634-4e5e-b1c0-937b3c4a7983 req-59726e71-ed09-40ce-b617-168ce8fab5a0 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state shelving.
Nov 28 19:05:42 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Deleted allocations for instance 325cbd77-1799-44f6-9b96-17f8a93b53b0
Nov 28 19:05:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'numa_topology' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:05:42 user nova-compute[75203]: DEBUG nova.objects.base [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Object Instance<325cbd77-1799-44f6-9b96-17f8a93b53b0> lazy-loaded attributes: resources,numa_topology {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:05:43 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:05:43 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:05:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:43 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6e55bc57-9515-4c14-8529-0b342fae25d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.992s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:05:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:05:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:05:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:05:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:05:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:00 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:02 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'flavor' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:03 user nova-compute[75203]: INFO nova.compute.manager [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Attaching volume b53f56c9-06d8-49e3-bc07-ace4283ece78 to /dev/vdb
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG os_brick.utils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178af1f-a3e1-4d2e-9fee-53c64986b6e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:03 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.171s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88fb10f-f7dd-4ce7-8509-eefd95ae51c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2f43d-49b4-4909-85ad-4be150b541f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef562fe-5d86-4a46-9ac2-e8879a062387]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:06:04 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7025fe-257c-4b44-ab52-9c442dfba9dd]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG os_brick.utils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== get_connector_properties: return (266ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating existing volume attachment record: 69ef714f-4164-4bb8-bb73-cfcf2c0f8641 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:06:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:05 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:06:05 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:06:05 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=24.944412231445312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8386807e-76ec-46b2-90e7-8391806f89c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 9de853a9-19ac-44d9-a9bc-768d6261c235 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:06:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:09 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:06:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:06:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:06:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErNxdRwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:06:10 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:06:10 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:06:10 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e545c0d2-594a-4b5c-9fd0-0b3cbc2f1de7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:06:10 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ad283-7042-45f4-ae60-6b32d577eb19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78] added
Nov 28 19:06:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2164f311-ec5b-4e11-9348-14fda03b7ceb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[db754b91-4e64-415d-8b3c-ad7d4cfa2b66]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErNxdRwX {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErNxdRwX" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20bf187-535f-481f-88b3-b64d77f4457a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ErNxdRwX'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acf77ff-dafa-428a-9563-1c3216d73e6b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bc5b5b-7db2-4e8f-b376-a8818522ffee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:06:10 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:06:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:06:10 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:06:10 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:06:10 user nova-compute[75203]: 
Nov 28 19:06:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a59b37-9b0a-4cfe-9cc2-3f1095d8dc45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]
Nov 28 19:06:11 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.
Nov 28 19:06:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[81edc512-828f-421a-8e84-b43c2b88d926]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2594bc-cda7-477a-8c66-ebd0643371be]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:06:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:06:11 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6ecb16-b932-46c8-b45c-041cdc70d977]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErNxdRwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:06:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26531636366613238', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531636366613238', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'flavor' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 19:06:12 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:06:12 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:06:12 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:06:12 user nova-compute[75203]:   <serial>b53f56c9-06d8-49e3-bc07-ace4283ece78</serial>
Nov 28 19:06:12 user nova-compute[75203]: </disk>
Nov 28 19:06:12 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No VIF found with MAC fa:16:3e:c6:0e:27, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:06:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f18db2c7-4303-431f-b97d-4836406c7399 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.894s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing instance network info cache due to event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG nova.network.neutron [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG nova.network.neutron [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updated VIF entry in instance network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG nova.network.neutron [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:06:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-37c7c2d5-b452-4815-a3c0-8e0c239112a1 req-4ba99485-fcbb-4a28-b1bd-b81106d09072 service nova] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:06:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:06:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:06:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing instance network info cache due to event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:06:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:06:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:06:20 user nova-compute[75203]: DEBUG nova.network.neutron [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:06:21 user nova-compute[75203]: DEBUG nova.network.neutron [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updated VIF entry in instance network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:06:21 user nova-compute[75203]: DEBUG nova.network.neutron [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:06:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5d940edf-e6fc-410f-9f6a-62ac5217c85f req-58530ab6-3cd6-4e30-b38a-53ef9ff83e42 service nova] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:06:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:24 user nova-compute[75203]: INFO nova.compute.manager [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Rebooting instance
Nov 28 19:06:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG nova.network.neutron [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG nova.network.neutron [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG nova.compute.manager [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-f313dc17-1e19-4bf2-a04c-7f045cc0a042 req-60705639-70e5-411c-a23f-72694d833aee service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-unplugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f313dc17-1e19-4bf2-a04c-7f045cc0a042 req-60705639-70e5-411c-a23f-72694d833aee service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f313dc17-1e19-4bf2-a04c-7f045cc0a042 req-60705639-70e5-411c-a23f-72694d833aee service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f313dc17-1e19-4bf2-a04c-7f045cc0a042 req-60705639-70e5-411c-a23f-72694d833aee service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:25 user nova-compute[75203]: DEBUG nova.compute.manager [req-f313dc17-1e19-4bf2-a04c-7f045cc0a042 req-60705639-70e5-411c-a23f-72694d833aee service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-unplugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:06:25 user nova-compute[75203]: WARNING nova.compute.manager [req-f313dc17-1e19-4bf2-a04c-7f045cc0a042 req-60705639-70e5-411c-a23f-72694d833aee service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received unexpected event network-vif-unplugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with vm_state active and task_state reboot_started_hard.
Nov 28 19:06:26 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance destroyed successfully.
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.objects.instance [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'resources' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-616332968',display_name='tempest-TestMinimumBasicScenario-server-616332968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-616332968',id=42,image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFOCpnB2b6DnSfoXsaqVLA3cdnNrL+wCW0k48+vaNwoDvNtXFSbiohAOXMOFTW/XAQNFDWcEIAJy707gWTctIFdyTpGufAZqZjbkBC+g9IqZkoif0H95gTL4udJNIII3w==',key_name='tempest-TestMinimumBasicScenario-1036669470',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:04:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-y5h8vpmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:06:25Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=8386807e-76ec-46b2-90e7-8391806f89c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_vif [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31aa148f-3b, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b0ddadc-d582-40bc-bee3-1057fb3bb7da) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:06:26 user nova-compute[75203]: INFO os_vif [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b')
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErNxdRwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:06:26 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c548e17-b13f-4568-9014-f49c68ffdcc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:06:26 user nova-compute[75203]: No targets found.
Nov 28 19:06:26 user nova-compute[75203]: iSNS:
Nov 28 19:06:26 user nova-compute[75203]: No targets found.
Nov 28 19:06:26 user nova-compute[75203]: STATIC:
Nov 28 19:06:26 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78
Nov 28 19:06:26 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:06:26 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:06:26 user nova-compute[75203]: FIRMWARE:
Nov 28 19:06:26 user nova-compute[75203]: No targets found.
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:06:26 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:06:26 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f315bc4-34f0-41ff-a9d4-307e98f947b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b02dffb-4544-4e17-9794-792c20bdbe1f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a01a1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[80940f5e-03e5-417b-a34f-e1c2b5e063d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff03105-a563-4e4e-991f-6abcc8b2f215]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3688e436-2dd4-4225-9d55-36f42761410a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae1c64-9754-4868-be13-e6a420965075]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b34bd1-b380-48ef-9d69-51e4d5480083]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eded64d-dee6-4068-970b-d74d09002196]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]
Nov 28 19:06:26 user nova-compute[75203]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa0df14-977f-4188-976f-091ce5e6fbbb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== disconnect_volume: return (273ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Start _get_guest_xml network_info=[{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f01c7807-d9ab-44a2-ac4b-9864fe5f51ac,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'f01c7807-d9ab-44a2-ac4b-9864fe5f51ac'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErNxdRwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8386807e-76ec-46b2-90e7-8391806f89c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b53f56c9-06d8-49e3-bc07-ace4283ece78', 'serial': 'b53f56c9-06d8-49e3-bc07-ace4283ece78'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '69ef714f-4164-4bb8-bb73-cfcf2c0f8641', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:06:26 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:06:26 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f01c7807-d9ab-44a2-ac4b-9864fe5f51ac,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.objects.instance [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.objects.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Object Instance<8386807e-76ec-46b2-90e7-8391806f89c8> lazy-loaded attributes: resources,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErNxdRwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:06:26 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:06:26 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:06:26 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2979b010-de51-4719-959d-7e954c708784]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:06:26 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ee8aac-6091-4f2a-90ec-f2d7432e281a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78] added
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30d15eb-5348-4486-b2c1-1565cec93b65]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[877c47dc-21e5-4b19-a9de-84b45ed2c096]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErNxdRwX {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErNxdRwX" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e01b98-0352-4f57-ab39-4f152124fedb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ErNxdRwX'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[335ead17-fb56-4b63-ae73-b8ce6cc2b569]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b6d49-1fc8-4fb9-8eb6-96da7fa7099f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:06:26 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:06:26 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:06:26 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:06:26 user nova-compute[75203]: 
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd554bd-8a49-4c1b-b250-c8556754f30f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]
Nov 28 19:06:26 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f9cd7-e5c1-46e9-8601-30a7ba12728a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[12223cdc-896f-4f92-8782-d6f8780fba3e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:06:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5db45d3-d4cc-4c88-aa2b-48dc6391ab06]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:06:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErNxdRwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:06:27 user nova-compute[75203]: DEBUG nova.compute.manager [req-64216fa4-9ac2-42b3-b19e-171f39703da4 req-cc7e80d3-583f-47ab-bb09-973d8fa07763 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:06:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-64216fa4-9ac2-42b3-b19e-171f39703da4 req-cc7e80d3-583f-47ab-bb09-973d8fa07763 service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-64216fa4-9ac2-42b3-b19e-171f39703da4 req-cc7e80d3-583f-47ab-bb09-973d8fa07763 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-64216fa4-9ac2-42b3-b19e-171f39703da4 req-cc7e80d3-583f-47ab-bb09-973d8fa07763 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:27 user nova-compute[75203]: DEBUG nova.compute.manager [req-64216fa4-9ac2-42b3-b19e-171f39703da4 req-cc7e80d3-583f-47ab-bb09-973d8fa07763 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:06:27 user nova-compute[75203]: WARNING nova.compute.manager [req-64216fa4-9ac2-42b3-b19e-171f39703da4 req-cc7e80d3-583f-47ab-bb09-973d8fa07763 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received unexpected event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with vm_state active and task_state reboot_started_hard.
Nov 28 19:06:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:06:27 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26531636366613238', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:06:27 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531636366613238', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-616332968',display_name='tempest-TestMinimumBasicScenario-server-616332968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-616332968',id=42,image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFOCpnB2b6DnSfoXsaqVLA3cdnNrL+wCW0k48+vaNwoDvNtXFSbiohAOXMOFTW/XAQNFDWcEIAJy707gWTctIFdyTpGufAZqZjbkBC+g9IqZkoif0H95gTL4udJNIII3w==',key_name='tempest-TestMinimumBasicScenario-1036669470',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:04:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-y5h8vpmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:06:25Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=8386807e-76ec-46b2-90e7-8391806f89c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.objects.instance [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'pci_devices' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.objects.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Object Instance<8386807e-76ec-46b2-90e7-8391806f89c8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:06:28 user nova-compute[75203]:   <uuid>8386807e-76ec-46b2-90e7-8391806f89c8</uuid>
Nov 28 19:06:28 user nova-compute[75203]:   <name>instance-0000002a</name>
Nov 28 19:06:28 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:06:28 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:06:28 user nova-compute[75203]:   <metadata>
Nov 28 19:06:28 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:06:28 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:06:28 user nova-compute[75203]:       <nova:name>tempest-TestMinimumBasicScenario-server-616332968</nova:name>
Nov 28 19:06:28 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:06:26</nova:creationTime>
Nov 28 19:06:28 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:06:28 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:06:28 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:06:28 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:06:28 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:06:28 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:06:28 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:06:28 user nova-compute[75203]:       <nova:owner>
Nov 28 19:06:28 user nova-compute[75203]:         <nova:user uuid="5327ccb36afb440396c9228baa2fb85d">tempest-TestMinimumBasicScenario-710384277-project-member</nova:user>
Nov 28 19:06:28 user nova-compute[75203]:         <nova:project uuid="478ac7f43b8c49abb6b7497869905748">tempest-TestMinimumBasicScenario-710384277</nova:project>
Nov 28 19:06:28 user nova-compute[75203]:       </nova:owner>
Nov 28 19:06:28 user nova-compute[75203]:       <nova:root type="image" uuid="f01c7807-d9ab-44a2-ac4b-9864fe5f51ac"/>
Nov 28 19:06:28 user nova-compute[75203]:       <nova:ports>
Nov 28 19:06:28 user nova-compute[75203]:         <nova:port uuid="31aa148f-3bea-4cc9-98f1-2e21a160c25c">
Nov 28 19:06:28 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 28 19:06:28 user nova-compute[75203]:         </nova:port>
Nov 28 19:06:28 user nova-compute[75203]:       </nova:ports>
Nov 28 19:06:28 user nova-compute[75203]:     </nova:instance>
Nov 28 19:06:28 user nova-compute[75203]:   </metadata>
Nov 28 19:06:28 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:06:28 user nova-compute[75203]:     <system>
Nov 28 19:06:28 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:06:28 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:06:28 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:06:28 user nova-compute[75203]:       <entry name="serial">8386807e-76ec-46b2-90e7-8391806f89c8</entry>
Nov 28 19:06:28 user nova-compute[75203]:       <entry name="uuid">8386807e-76ec-46b2-90e7-8391806f89c8</entry>
Nov 28 19:06:28 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:06:28 user nova-compute[75203]:     </system>
Nov 28 19:06:28 user nova-compute[75203]:   </sysinfo>
Nov 28 19:06:28 user nova-compute[75203]:   <os>
Nov 28 19:06:28 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:06:28 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:06:28 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:06:28 user nova-compute[75203]:   </os>
Nov 28 19:06:28 user nova-compute[75203]:   <features>
Nov 28 19:06:28 user nova-compute[75203]:     <acpi/>
Nov 28 19:06:28 user nova-compute[75203]:     <apic/>
Nov 28 19:06:28 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:06:28 user nova-compute[75203]:   </features>
Nov 28 19:06:28 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:06:28 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:06:28 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:06:28 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:06:28 user nova-compute[75203]:   </clock>
Nov 28 19:06:28 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:06:28 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:06:28 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:06:28 user nova-compute[75203]:   </cpu>
Nov 28 19:06:28 user nova-compute[75203]:   <devices>
Nov 28 19:06:28 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:06:28 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:06:28 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk"/>
Nov 28 19:06:28 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:06:28 user nova-compute[75203]:     </disk>
Nov 28 19:06:28 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:06:28 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:06:28 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 19:06:28 user nova-compute[75203]:       <target dev="vdb" bus="virtio"/>
Nov 28 19:06:28 user nova-compute[75203]:       <serial>b53f56c9-06d8-49e3-bc07-ace4283ece78</serial>
Nov 28 19:06:28 user nova-compute[75203]:     </disk>
Nov 28 19:06:28 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:06:28 user nova-compute[75203]:       <mac address="fa:16:3e:c6:0e:27"/>
Nov 28 19:06:28 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:06:28 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:06:28 user nova-compute[75203]:       <target dev="tap31aa148f-3b"/>
Nov 28 19:06:28 user nova-compute[75203]:     </interface>
Nov 28 19:06:28 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:06:28 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/console.log" append="off"/>
Nov 28 19:06:28 user nova-compute[75203]:     </serial>
Nov 28 19:06:28 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:06:28 user nova-compute[75203]:     <video>
Nov 28 19:06:28 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:06:28 user nova-compute[75203]:     </video>
Nov 28 19:06:28 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:06:28 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:06:28 user nova-compute[75203]:     </rng>
Nov 28 19:06:28 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:06:28 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:06:28 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:06:28 user nova-compute[75203]:     </memballoon>
Nov 28 19:06:28 user nova-compute[75203]:   </devices>
Nov 28 19:06:28 user nova-compute[75203]: </domain>
Nov 28 19:06:28 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.objects.instance [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.objects.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Object Instance<8386807e-76ec-46b2-90e7-8391806f89c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Cannot resize image /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.objects.instance [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'migration_context' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.objects.base [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Object Instance<8386807e-76ec-46b2-90e7-8391806f89c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-616332968',display_name='tempest-TestMinimumBasicScenario-server-616332968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-616332968',id=42,image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFOCpnB2b6DnSfoXsaqVLA3cdnNrL+wCW0k48+vaNwoDvNtXFSbiohAOXMOFTW/XAQNFDWcEIAJy707gWTctIFdyTpGufAZqZjbkBC+g9IqZkoif0H95gTL4udJNIII3w==',key_name='tempest-TestMinimumBasicScenario-1036669470',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:04:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-y5h8vpmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:06:25Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=8386807e-76ec-46b2-90e7-8391806f89c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG os_vif [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c4ca895-ed1d-5606-92f1-4778f5839167', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31aa148f-3b, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31aa148f-3b, col_values=(('qos', UUID('8761a345-3857-419b-aa45-d6973b9f5e4b')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31aa148f-3b, col_values=(('external_ids', {'iface-id': '31aa148f-3bea-4cc9-98f1-2e21a160c25c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:0e:27', 'vm-uuid': '8386807e-76ec-46b2-90e7-8391806f89c8'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:06:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:28 user nova-compute[75203]: INFO os_vif [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b')
Nov 28 19:06:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4fd7552-5b40-4efd-b1ff-0d8a3c14f79e req-433a3e12-a197-4bb9-ab91-e99f37b3cd8a service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4fd7552-5b40-4efd-b1ff-0d8a3c14f79e req-433a3e12-a197-4bb9-ab91-e99f37b3cd8a service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4fd7552-5b40-4efd-b1ff-0d8a3c14f79e req-433a3e12-a197-4bb9-ab91-e99f37b3cd8a service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4fd7552-5b40-4efd-b1ff-0d8a3c14f79e req-433a3e12-a197-4bb9-ab91-e99f37b3cd8a service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4fd7552-5b40-4efd-b1ff-0d8a3c14f79e req-433a3e12-a197-4bb9-ab91-e99f37b3cd8a service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:06:30 user nova-compute[75203]: WARNING nova.compute.manager [req-f4fd7552-5b40-4efd-b1ff-0d8a3c14f79e req-433a3e12-a197-4bb9-ab91-e99f37b3cd8a service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received unexpected event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with vm_state active and task_state reboot_started_hard.
Nov 28 19:06:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:32 user nova-compute[75203]: DEBUG nova.compute.manager [req-51a9edee-08ca-489f-9b61-ff5443454a86 req-59ebbf73-5757-4016-8674-31e327c3f071 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:06:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-51a9edee-08ca-489f-9b61-ff5443454a86 req-59ebbf73-5757-4016-8674-31e327c3f071 service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:06:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-51a9edee-08ca-489f-9b61-ff5443454a86 req-59ebbf73-5757-4016-8674-31e327c3f071 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:06:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-51a9edee-08ca-489f-9b61-ff5443454a86 req-59ebbf73-5757-4016-8674-31e327c3f071 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:32 user nova-compute[75203]: DEBUG nova.compute.manager [req-51a9edee-08ca-489f-9b61-ff5443454a86 req-59ebbf73-5757-4016-8674-31e327c3f071 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:06:32 user nova-compute[75203]: WARNING nova.compute.manager [req-51a9edee-08ca-489f-9b61-ff5443454a86 req-59ebbf73-5757-4016-8674-31e327c3f071 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received unexpected event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with vm_state active and task_state reboot_started_hard.
Nov 28 19:06:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:06:32 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance rebooted successfully.
Nov 28 19:06:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:06:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-34720b83-ce70-42d2-9f0b-35c5f5e6abc3 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.620s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:06:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:06:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:06:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:06:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:06:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:06:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:02 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:02 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:03 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:04 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:07:04 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:07:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=24.94164276123047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8386807e-76ec-46b2-90e7-8391806f89c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 9de853a9-19ac-44d9-a9bc-768d6261c235 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:07:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:07:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:09 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:07:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:07:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:07:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:07:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:07:09 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:10 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:07:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:07:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:07:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:07:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:07:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:07:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-changed-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:07:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Refreshing instance network info cache due to event network-changed-84839b11-70ab-47e4-b2d2-5e3b170ac7ec. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:07:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] Acquiring lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:07:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] Acquired lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:07:26 user nova-compute[75203]: DEBUG nova.network.neutron [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Refreshing network info cache for port 84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:07:27 user nova-compute[75203]: DEBUG nova.network.neutron [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updated VIF entry in instance network info cache for port 84839b11-70ab-47e4-b2d2-5e3b170ac7ec. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:07:27 user nova-compute[75203]: DEBUG nova.network.neutron [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updating instance_info_cache with network_info: [{"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:07:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b40c5ec5-46f2-42b9-8b68-381eb3b5df9f req-72177335-33bb-4cc4-9a2f-166d12046872 service nova] Releasing lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:07:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG nova.objects.instance [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:29 user nova-compute[75203]: INFO nova.compute.manager [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Attaching volume d5866dff-c782-41c0-b422-7258020a23b7 to /dev/vdb
Nov 28 19:07:29 user nova-compute[75203]: DEBUG os_brick.utils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe3aa35-5d76-4889-a450-8460b06b1be9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:29 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f25f92-c71e-4fc7-b335-105ddd223535]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c5bc98-4beb-49c0-9cbb-bc91e9023ac6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb27cc6f-4ecf-4509-a262-3b173165e3e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:07:30 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe371b8f-fe82-4ddc-b375-efb64bfeb12e]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.utils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updating existing volume attachment record: 4c73ca4b-1a5b-4584-9b34-382022660285 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:30 user nova-compute[75203]: INFO nova.compute.manager [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Unshelving
Nov 28 19:07:30 user nova-compute[75203]: INFO nova.virt.block_device [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Booting with volume 1d907e48-caa5-4a73-9e63-bd353480e452 at /dev/vda
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.utils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[df906c06-1623-45af-8418-8ed4c821a50d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[16242780-7199-40c3-bbe2-3004d0c16f93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906f5ee-24c8-4776-8e03-8cb758e6b0eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925eed0-86f2-4606-be74-b44220459b0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:07:30 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:07:30 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7848bb6-b52e-4f62-a2a5-32532846ea8a]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG os_brick.utils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:07:30 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating existing volume attachment record: 63f06fff-d02f-467a-af2d-f37d2f3e7afb {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:07:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRJIAFxK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:07:37 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:07:37 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:07:37 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11ddee4-d718-41c2-9159-2eab2df09a7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:07:37 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1948a-3146-4a22-b187-fa8395a9760c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7] added
Nov 28 19:07:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[109cb085-3efa-4d56-9154-63d12cff525d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacaa596-6241-4ae9-b59c-ac1179e8e764]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRJIAFxK {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRJIAFxK" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb5ecfe-9948-4bbe-bfca-0d5b2c5075ba]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nRJIAFxK'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c5d5d-aa83-4d52-80c7-7c4c55917e31]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6941fd-61dc-4d95-94a0-940dcf19e077]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7290854-5150-4a96-ae8d-a494b0d1a1fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260]
Nov 28 19:07:37 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260] successful.
Nov 28 19:07:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8b34ce-4dce-4266-9002-4d0ef1e57139]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[96628518-b018-4155-b733-6f148725c949]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:37 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:37 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:37 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a79dfd-c7a2-47aa-9d68-a162ade84d68]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG nova.objects.instance [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'pci_requests' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG nova.objects.instance [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'numa_topology' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:07:37 user nova-compute[75203]: INFO nova.compute.claims [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Claim successful on node user
Nov 28 19:07:37 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:07:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:38 user nova-compute[75203]: INFO nova.network.neutron [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating port 214e9746-a41c-4671-b7de-d89039d075af with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRJIAFxK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23239356632393136', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239356632393136', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.objects.instance [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 19:07:38 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:07:38 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 19:07:38 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:07:38 user nova-compute[75203]:   <serial>d5866dff-c782-41c0-b422-7258020a23b7</serial>
Nov 28 19:07:38 user nova-compute[75203]: </disk>
Nov 28 19:07:38 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-changed-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing instance network info cache due to event network-changed-214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No VIF found with MAC fa:16:3e:10:f2:a6, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-164e9766-d6dc-4868-9123-5f1a5e2f84fa tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.010s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.network.neutron [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:07:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Creating image(s)
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Ensure instance console log exists: /opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Start _get_guest_xml network_info=[{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '325cbd77-1799-44f6-9b96-17f8a93b53b0', 'attached_at': '', 'detached_at': '', 'volume_id': '1d907e48-caa5-4a73-9e63-bd353480e452', 'serial': '1d907e48-caa5-4a73-9e63-bd353480e452'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '63f06fff-d02f-467a-af2d-f37d2f3e7afb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing network info cache for port 214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:07:39 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:07:39 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.objects.instance [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'vcpu_model' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.objects.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Object Instance<325cbd77-1799-44f6-9b96-17f8a93b53b0> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:07:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:07:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:07:39 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb1f6f3-d879-411a-bfb6-02e4d666a662]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:07:39 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6f805f-a018-45d1-85e0-7305e6d0d648]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452] added
Nov 28 19:07:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f2fe4-390f-4e2b-aa7f-147eeffd08fc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.062s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80667e8-92ff-436e-a807-5410db90967c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JINpHSes {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JINpHSes" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b892f7-82a6-43c6-a082-03d5f023b223]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JINpHSes'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a18e22-88a8-41b8-a373-3aaae6f98338]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58355f5-3c66-4104-a1dc-736b67efc413]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[671861b7-7df7-432d-b402-d1dccde82ad6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]
Nov 28 19:07:39 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.
Nov 28 19:07:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3091d8-de90-496a-a3ab-d094f247a3bf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[652bcae1-8979-4487-b4fa-0b26bc20bdd2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:07:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updated VIF entry in instance network info cache for port 214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ee4462-ae15-4369-b2aa-5932e97ae796]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:07:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-53b20737-375e-4e9e-a214-e3e0f16fc238 req-fd81c9c4-915a-4136-bd9a-c7bae1bdb52b service nova] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26262656164663531', 'path': '/dev/sdd'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262656164663531', 'path': '/dev/sdd'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385744915',display_name='tempest-TestShelveInstance-server-1385744915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385744915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1256305827',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5b7e2cd3ffb24750b81033db41a35a4d',ramdisk_id='',reservation_id='r-zal341xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-865744978',owner_user_name='tempest-TestShelveInstance-865744978-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:07:31Z,user_data=None,user_id='c7545511dc1d4fa5ba723a110312fa4f',uuid=325cbd77-1799-44f6-9b96-17f8a93b53b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converting VIF {"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.objects.instance [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'pci_devices' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.objects.base [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Object Instance<325cbd77-1799-44f6-9b96-17f8a93b53b0> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75203) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:07:40 user nova-compute[75203]:   <uuid>325cbd77-1799-44f6-9b96-17f8a93b53b0</uuid>
Nov 28 19:07:40 user nova-compute[75203]:   <name>instance-00000029</name>
Nov 28 19:07:40 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:07:40 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:07:40 user nova-compute[75203]:   <metadata>
Nov 28 19:07:40 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:07:40 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:07:40 user nova-compute[75203]:       <nova:name>tempest-TestShelveInstance-server-1385744915</nova:name>
Nov 28 19:07:40 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:07:39</nova:creationTime>
Nov 28 19:07:40 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:07:40 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:07:40 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:07:40 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:07:40 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:07:40 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:07:40 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:07:40 user nova-compute[75203]:       <nova:owner>
Nov 28 19:07:40 user nova-compute[75203]:         <nova:user uuid="c7545511dc1d4fa5ba723a110312fa4f">tempest-TestShelveInstance-865744978-project-member</nova:user>
Nov 28 19:07:40 user nova-compute[75203]:         <nova:project uuid="5b7e2cd3ffb24750b81033db41a35a4d">tempest-TestShelveInstance-865744978</nova:project>
Nov 28 19:07:40 user nova-compute[75203]:       </nova:owner>
Nov 28 19:07:40 user nova-compute[75203]:       <nova:ports>
Nov 28 19:07:40 user nova-compute[75203]:         <nova:port uuid="214e9746-a41c-4671-b7de-d89039d075af">
Nov 28 19:07:40 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 19:07:40 user nova-compute[75203]:         </nova:port>
Nov 28 19:07:40 user nova-compute[75203]:       </nova:ports>
Nov 28 19:07:40 user nova-compute[75203]:     </nova:instance>
Nov 28 19:07:40 user nova-compute[75203]:   </metadata>
Nov 28 19:07:40 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:07:40 user nova-compute[75203]:     <system>
Nov 28 19:07:40 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:07:40 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:07:40 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:07:40 user nova-compute[75203]:       <entry name="serial">325cbd77-1799-44f6-9b96-17f8a93b53b0</entry>
Nov 28 19:07:40 user nova-compute[75203]:       <entry name="uuid">325cbd77-1799-44f6-9b96-17f8a93b53b0</entry>
Nov 28 19:07:40 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:07:40 user nova-compute[75203]:     </system>
Nov 28 19:07:40 user nova-compute[75203]:   </sysinfo>
Nov 28 19:07:40 user nova-compute[75203]:   <os>
Nov 28 19:07:40 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:07:40 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:07:40 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:07:40 user nova-compute[75203]:   </os>
Nov 28 19:07:40 user nova-compute[75203]:   <features>
Nov 28 19:07:40 user nova-compute[75203]:     <acpi/>
Nov 28 19:07:40 user nova-compute[75203]:     <apic/>
Nov 28 19:07:40 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:07:40 user nova-compute[75203]:   </features>
Nov 28 19:07:40 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:07:40 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:07:40 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:07:40 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:07:40 user nova-compute[75203]:   </clock>
Nov 28 19:07:40 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:07:40 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:07:40 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:07:40 user nova-compute[75203]:   </cpu>
Nov 28 19:07:40 user nova-compute[75203]:   <devices>
Nov 28 19:07:40 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:07:40 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:07:40 user nova-compute[75203]:       <source dev="/dev/sdd"/>
Nov 28 19:07:40 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:07:40 user nova-compute[75203]:       <serial>1d907e48-caa5-4a73-9e63-bd353480e452</serial>
Nov 28 19:07:40 user nova-compute[75203]:     </disk>
Nov 28 19:07:40 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:07:40 user nova-compute[75203]:       <mac address="fa:16:3e:de:6e:1b"/>
Nov 28 19:07:40 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:07:40 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:07:40 user nova-compute[75203]:       <target dev="tap214e9746-a4"/>
Nov 28 19:07:40 user nova-compute[75203]:     </interface>
Nov 28 19:07:40 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:07:40 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0/console.log" append="off"/>
Nov 28 19:07:40 user nova-compute[75203]:     </serial>
Nov 28 19:07:40 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:07:40 user nova-compute[75203]:     <video>
Nov 28 19:07:40 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:07:40 user nova-compute[75203]:     </video>
Nov 28 19:07:40 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:07:40 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:07:40 user nova-compute[75203]:     </rng>
Nov 28 19:07:40 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:07:40 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:07:40 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:07:40 user nova-compute[75203]:     </memballoon>
Nov 28 19:07:40 user nova-compute[75203]:   </devices>
Nov 28 19:07:40 user nova-compute[75203]: </domain>
Nov 28 19:07:40 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385744915',display_name='tempest-TestShelveInstance-server-1385744915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385744915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1256305827',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5b7e2cd3ffb24750b81033db41a35a4d',ramdisk_id='',reservation_id='r-zal341xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-865744978',owner_user_name='tempest-TestShelveInstance-865744978-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:07:31Z,user_data=None,user_id='c7545511dc1d4fa5ba723a110312fa4f',uuid=325cbd77-1799-44f6-9b96-17f8a93b53b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converting VIF {"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG os_vif [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36831dad-c6b0-58bb-b0ca-4c92828f21de', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap214e9746-a4, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap214e9746-a4, col_values=(('qos', UUID('79785243-0e75-4057-ba4e-b5b143a33953')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap214e9746-a4, col_values=(('external_ids', {'iface-id': '214e9746-a41c-4671-b7de-d89039d075af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:6e:1b', 'vm-uuid': '325cbd77-1799-44f6-9b96-17f8a93b53b0'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:40 user nova-compute[75203]: INFO os_vif [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4')
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:07:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] No VIF found with MAC fa:16:3e:de:6e:1b, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:07:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-0f48cf53-8d55-4b49-869c-ef1e29b7b8c8 req-c046ce0a-f9dc-4ffa-9bba-4334365d599f service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0f48cf53-8d55-4b49-869c-ef1e29b7b8c8 req-c046ce0a-f9dc-4ffa-9bba-4334365d599f service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0f48cf53-8d55-4b49-869c-ef1e29b7b8c8 req-c046ce0a-f9dc-4ffa-9bba-4334365d599f service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0f48cf53-8d55-4b49-869c-ef1e29b7b8c8 req-c046ce0a-f9dc-4ffa-9bba-4334365d599f service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-0f48cf53-8d55-4b49-869c-ef1e29b7b8c8 req-c046ce0a-f9dc-4ffa-9bba-4334365d599f service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:07:42 user nova-compute[75203]: WARNING nova.compute.manager [req-0f48cf53-8d55-4b49-869c-ef1e29b7b8c8 req-c046ce0a-f9dc-4ffa-9bba-4334365d599f service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:42 user nova-compute[75203]: INFO nova.compute.manager [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Attaching volume 811e0b8e-aafe-455c-a093-a2c8ab527d2f to /dev/vdc
Nov 28 19:07:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG os_brick.utils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92b72b2-7b75-4d01-9761-f1cc1979772b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6894ce-2c9c-4853-b0d5-6c1cd0b6a56e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc5ddb-518b-4fec-9562-76c8a2f40d89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ee4c82-2ab9-4fa5-bdca-4e2ca942152f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:07:42 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:07:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b12a69-6176-4f8e-af85-d04b66d0373f]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG os_brick.utils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:07:42 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updating existing volume attachment record: 74825fe3-a693-4b67-95e6-cb8315131e37 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:07:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:07:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:07:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance spawned successfully.
Nov 28 19:07:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:07:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-3f8db21b-7e52-4546-b071-8ddffc85dc55 req-e24214c3-39dc-42d4-b7b0-70c6df0065c4 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:07:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3f8db21b-7e52-4546-b071-8ddffc85dc55 req-e24214c3-39dc-42d4-b7b0-70c6df0065c4 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3f8db21b-7e52-4546-b071-8ddffc85dc55 req-e24214c3-39dc-42d4-b7b0-70c6df0065c4 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3f8db21b-7e52-4546-b071-8ddffc85dc55 req-e24214c3-39dc-42d4-b7b0-70c6df0065c4 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-3f8db21b-7e52-4546-b071-8ddffc85dc55 req-e24214c3-39dc-42d4-b7b0-70c6df0065c4 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:07:44 user nova-compute[75203]: WARNING nova.compute.manager [req-3f8db21b-7e52-4546-b071-8ddffc85dc55 req-e24214c3-39dc-42d4-b7b0-70c6df0065c4 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state shelved_offloaded and task_state spawning.
Nov 28 19:07:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-19c50264-5599-4462-a2cb-105c0c9755d2 tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.753s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrfiFSTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:07:50 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:07:50 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:07:50 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[247a2873-706a-44a6-9298-1eff4609eb5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:07:50 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2737f9f-f747-451c-ad95-be696bf54a14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f] added
Nov 28 19:07:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa59ebd-f0af-4703-a1eb-fd047e2dfd52]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a7bfd-2cd1-4cd1-8692-99c0d7c06c1d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrfiFSTq {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrfiFSTq" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a712477-fd46-4124-8770-d0cea63221a3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LrfiFSTq'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c1887c-fcc8-4605-a68f-1f3019611e95]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60b318-7f59-4a11-88e7-832248dd11f7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba586f-d308-4800-b237-a31836edead7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260]
Nov 28 19:07:50 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260] successful.
Nov 28 19:07:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[779569e2-f01d-49b1-9ebc-47c6642f416a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7894562c-6439-46b8-ac4f-bfb0a988cd1e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)
Nov 28 19:07:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:07:50 user nova-compute[75203]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)
Nov 28 19:07:50 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497aa98-add2-4c74-82bf-f205329f9654]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrfiFSTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:07:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26564343264343431', 'path': '/dev/sde'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564343264343431', 'path': '/dev/sde'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 19:07:51 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:07:51 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 19:07:51 user nova-compute[75203]:   <target dev="vdc" bus="virtio"/>
Nov 28 19:07:51 user nova-compute[75203]:   <serial>811e0b8e-aafe-455c-a093-a2c8ab527d2f</serial>
Nov 28 19:07:51 user nova-compute[75203]: </disk>
Nov 28 19:07:51 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] No VIF found with MAC fa:16:3e:10:f2:a6, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:07:51 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-5de1e708-cfff-4d10-bdc5-86216b09927b tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.478s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:07:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:07:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:07:52 user nova-compute[75203]: INFO nova.compute.manager [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Detaching volume d5866dff-c782-41c0-b422-7258020a23b7
Nov 28 19:07:52 user nova-compute[75203]: INFO nova.virt.block_device [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Attempting to driver detach volume d5866dff-c782-41c0-b422-7258020a23b7 from mountpoint /dev/vdb
Nov 28 19:07:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Attempting to detach device vdb from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:07:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:07:52 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:07:52 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 19:07:52 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:07:52 user nova-compute[75203]:   <serial>d5866dff-c782-41c0-b422-7258020a23b7</serial>
Nov 28 19:07:52 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:07:52 user nova-compute[75203]: </disk>
Nov 28 19:07:52 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:07:52 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully detached device vdb from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the persistent domain config.
Nov 28 19:07:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:07:52 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:07:52 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:07:52 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 19:07:52 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:07:52 user nova-compute[75203]:   <serial>d5866dff-c782-41c0-b422-7258020a23b7</serial>
Nov 28 19:07:52 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:07:52 user nova-compute[75203]: </disk>
Nov 28 19:07:52 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:07:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:07:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:07:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:03 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:03 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:05 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:05 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:08:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:08:07 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:08:07 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=24.939289093017578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8386807e-76ec-46b2-90e7-8391806f89c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 9de853a9-19ac-44d9-a9bc-768d6261c235 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 325cbd77-1799-44f6-9b96-17f8a93b53b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:08:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:08:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:08:11 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:08:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:08:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:08:11 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:08:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updating instance_info_cache with network_info: [{"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:08:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-9de853a9-19ac-44d9-a9bc-768d6261c235" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:08:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:08:13 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 is timed out.
Nov 28 19:08:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully detached device vdb from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the live domain config.
Nov 28 19:08:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRJIAFxK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:08:13 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d27820-d21c-4def-b4e4-c269f6704553]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:08:13 user nova-compute[75203]: No targets found.
Nov 28 19:08:13 user nova-compute[75203]: iSNS:
Nov 28 19:08:13 user nova-compute[75203]: No targets found.
Nov 28 19:08:13 user nova-compute[75203]: STATIC:
Nov 28 19:08:13 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7
Nov 28 19:08:13 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:13 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:13 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f
Nov 28 19:08:13 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:13 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:13 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78
Nov 28 19:08:13 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:13 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:13 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452
Nov 28 19:08:13 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:13 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:13 user nova-compute[75203]: FIRMWARE:
Nov 28 19:08:13 user nova-compute[75203]: No targets found.
Nov 28 19:08:13 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:08:13 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:08:13 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d542dc2d-cba3-4fe8-9015-232f95a89815]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d008a896-ae5c-4c1b-a686-5a77d3968c2b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:08:13 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:08:13 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:08:13 user nova-compute[75203]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)
Nov 28 19:08:13 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:08:13 user nova-compute[75203]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 (non-flash)
Nov 28 19:08:13 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:08:13 user nova-compute[75203]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)
Nov 28 19:08:13 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903f7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a00a9-a630-4c04-b3a0-437a7785d1f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a9d621-35ec-49f1-869d-0ad8611b01f5]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b5fb5-503c-4fe4-8bd5-45c63f89e60e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e85aa0-3ea0-406b-83bf-3cc1daa58271]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c895900-5441-4e62-9212-82957c287d12]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3807c838-446a-4cf6-a08d-0de61a81108b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260]
Nov 28 19:08:13 user nova-compute[75203]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7, portal: 172.16.0.220,3260] successful.
Nov 28 19:08:13 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5866dff-c782-41c0-b422-7258020a23b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385efe4-dc64-4b16-846c-aacb7f10f655]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== disconnect_volume: return (317ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:08:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:14 user nova-compute[75203]: DEBUG nova.objects.instance [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:08:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-dfe06200-f1a2-4dff-892a-c957b7716a6f tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:15 user nova-compute[75203]: INFO nova.compute.manager [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Detaching volume 811e0b8e-aafe-455c-a093-a2c8ab527d2f
Nov 28 19:08:15 user nova-compute[75203]: INFO nova.virt.block_device [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Attempting to driver detach volume 811e0b8e-aafe-455c-a093-a2c8ab527d2f from mountpoint /dev/vdc
Nov 28 19:08:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Attempting to detach device vdc from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:08:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:08:15 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:08:15 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 19:08:15 user nova-compute[75203]:   <target dev="vdc" bus="virtio"/>
Nov 28 19:08:15 user nova-compute[75203]:   <serial>811e0b8e-aafe-455c-a093-a2c8ab527d2f</serial>
Nov 28 19:08:15 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 19:08:15 user nova-compute[75203]: </disk>
Nov 28 19:08:15 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:08:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully detached device vdc from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the persistent domain config.
Nov 28 19:08:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:08:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:08:15 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:08:15 user nova-compute[75203]:   <source dev="/dev/sde"/>
Nov 28 19:08:15 user nova-compute[75203]:   <target dev="vdc" bus="virtio"/>
Nov 28 19:08:15 user nova-compute[75203]:   <serial>811e0b8e-aafe-455c-a093-a2c8ab527d2f</serial>
Nov 28 19:08:15 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 28 19:08:15 user nova-compute[75203]: </disk>
Nov 28 19:08:15 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:08:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:08:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing instance network info cache due to event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:08:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:08:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:08:16 user nova-compute[75203]: DEBUG nova.network.neutron [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updated VIF entry in instance network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c3c3b12d-f38b-4b49-b159-10df8d1f3140 req-1b40b8a4-79d9-4135-84b5-7e76ad53dd77 service nova] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing instance network info cache due to event network-changed-31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] Acquiring lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] Acquired lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Refreshing network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:17 user nova-compute[75203]: INFO nova.compute.manager [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Detaching volume b53f56c9-06d8-49e3-bc07-ace4283ece78
Nov 28 19:08:17 user nova-compute[75203]: INFO nova.virt.block_device [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Attempting to driver detach volume b53f56c9-06d8-49e3-bc07-ace4283ece78 from mountpoint /dev/vdb
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Attempting to detach device vdb from instance 8386807e-76ec-46b2-90e7-8391806f89c8 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:08:17 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:08:17 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:08:17 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:08:17 user nova-compute[75203]:   <serial>b53f56c9-06d8-49e3-bc07-ace4283ece78</serial>
Nov 28 19:08:17 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 19:08:17 user nova-compute[75203]: </disk>
Nov 28 19:08:17 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:08:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully detached device vdb from instance 8386807e-76ec-46b2-90e7-8391806f89c8 from the persistent domain config.
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8386807e-76ec-46b2-90e7-8391806f89c8 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:08:17 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:08:17 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:08:17 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:08:17 user nova-compute[75203]:   <serial>b53f56c9-06d8-49e3-bc07-ace4283ece78</serial>
Nov 28 19:08:17 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 28 19:08:17 user nova-compute[75203]: </disk>
Nov 28 19:08:17 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updated VIF entry in instance network info cache for port 31aa148f-3bea-4cc9-98f1-2e21a160c25c. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [{"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:08:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-91ab6e91-5885-4d35-be61-cba0d81c81dd req-89ba06ea-64e4-4e14-8464-255f72b6500c service nova] Releasing lock "refresh_cache-8386807e-76ec-46b2-90e7-8391806f89c8" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:08:18 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:08:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:08:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:08:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:08:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:08:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:35 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 is timed out.
Nov 28 19:08:35 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully detached device vdc from instance 9de853a9-19ac-44d9-a9bc-768d6261c235 from the live domain config.
Nov 28 19:08:35 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrfiFSTq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:08:35 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3fa0b4-c1fe-4015-8a65-6175fa155e6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:08:35 user nova-compute[75203]: No targets found.
Nov 28 19:08:35 user nova-compute[75203]: iSNS:
Nov 28 19:08:35 user nova-compute[75203]: No targets found.
Nov 28 19:08:35 user nova-compute[75203]: STATIC:
Nov 28 19:08:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f
Nov 28 19:08:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78
Nov 28 19:08:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:35 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452
Nov 28 19:08:35 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:35 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:35 user nova-compute[75203]: FIRMWARE:
Nov 28 19:08:35 user nova-compute[75203]: No targets found.
Nov 28 19:08:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:08:35 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:08:35 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b4504b-c87f-4a6e-831b-55d597885ada]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f8e94-610e-49ba-9d06-9649dcbab8fb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:08:35 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:08:35 user nova-compute[75203]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)
Nov 28 19:08:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:08:35 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:08:35 user nova-compute[75203]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f (non-flash)
Nov 28 19:08:35 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f079026bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f'): ({'sde'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Removing single pathed devices sde {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb6d07c-ba01-44cc-87fd-0aa986313603]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e10c23-abcf-42cc-9540-d339db6ef7f3]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Flushing IO for device /dev/sde {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7441e55-2d64-450e-b7dd-fbf1f3adebcc]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:08:35 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ba2353-0576-48e5-a5a4-99b57590ba7e]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] SCSI volumes sde have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d3d6f6-d4f4-4df5-ae64-c6ff1db21401]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f39fdcc-bbc2-422b-a8f4-94311aa357e0]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260]
Nov 28 19:08:36 user nova-compute[75203]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f, portal: 172.16.0.220,3260] successful.
Nov 28 19:08:36 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811e0b8e-aafe-455c-a093-a2c8ab527d2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d185681f-3803-4438-a023-002409caa6dd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] <== disconnect_volume: return (277ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG nova.objects.instance [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'flavor' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:08:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-09ee1261-4e73-4f1f-9e87-c639286564c7 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:38 user nova-compute[75203]: INFO nova.compute.manager [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Terminating instance
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8386807e-76ec-46b2-90e7-8391806f89c8 is timed out.
Nov 28 19:08:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully detached device vdb from instance 8386807e-76ec-46b2-90e7-8391806f89c8 from the live domain config.
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErNxdRwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:08:38 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0168bb43-5024-4085-ba82-73d513912d7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:08:38 user nova-compute[75203]: No targets found.
Nov 28 19:08:38 user nova-compute[75203]: iSNS:
Nov 28 19:08:38 user nova-compute[75203]: No targets found.
Nov 28 19:08:38 user nova-compute[75203]: STATIC:
Nov 28 19:08:38 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78
Nov 28 19:08:38 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:38 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:38 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452
Nov 28 19:08:38 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:08:38 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:08:38 user nova-compute[75203]: FIRMWARE:
Nov 28 19:08:38 user nova-compute[75203]: No targets found.
Nov 28 19:08:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:08:38 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:08:38 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d29b866-a225-4e33-9c3a-a38cea62518d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1226f-74ac-4fa6-8504-77d8fd0cb484]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:08:38 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:08:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 (non-flash)
Nov 28 19:08:38 user nova-compute[75203]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:08:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07901f71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-5bcf7026-43fb-4f69-b1b4-1bb330daabc7 req-53c49260-fd6e-4d03-89a6-b2cdcd9e26cc service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-unplugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5bcf7026-43fb-4f69-b1b4-1bb330daabc7 req-53c49260-fd6e-4d03-89a6-b2cdcd9e26cc service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5bcf7026-43fb-4f69-b1b4-1bb330daabc7 req-53c49260-fd6e-4d03-89a6-b2cdcd9e26cc service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5bcf7026-43fb-4f69-b1b4-1bb330daabc7 req-53c49260-fd6e-4d03-89a6-b2cdcd9e26cc service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-5bcf7026-43fb-4f69-b1b4-1bb330daabc7 req-53c49260-fd6e-4d03-89a6-b2cdcd9e26cc service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-unplugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-5bcf7026-43fb-4f69-b1b4-1bb330daabc7 req-53c49260-fd6e-4d03-89a6-b2cdcd9e26cc service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-unplugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a77148e-9e0c-4f34-b839-6acd7edb0bcf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0716371b-a04a-4dc1-a5df-5278b2240094]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24464fc-393b-460e-8b51-af597370ef54]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3c076e-fbfb-491e-8ff6-ac605a68c71c]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5bf92a-ed58-461a-a2ff-24f5ecf8ec67]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[036045fb-fa4b-4a24-8dcb-112168737a24]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260]
Nov 28 19:08:38 user nova-compute[75203]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78, portal: 172.16.0.220,3260] successful.
Nov 28 19:08:38 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b53f56c9-06d8-49e3-bc07-ace4283ece78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34dc6a5-ce70-4d12-a073-4368ba5100b8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== disconnect_volume: return (285ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Instance destroyed successfully.
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.objects.instance [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lazy-loading 'resources' on Instance uuid 9de853a9-19ac-44d9-a9bc-768d6261c235 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1933108232',display_name='tempest-AttachVolumeTestJSON-server-1933108232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1933108232',id=43,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtwcCu+y8G/Za8cg0XRSRaVvGphzhPN2cW0GqJq/wmnUSsRwI7XwsVoNmCqG5hqsBNP2NOiEiZVu7JGAKNY29zMBEA+U7ANekPgjY0ncjSjl9UB14mFI08uRlgcjNlbHw==',key_name='tempest-keypair-536936720',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:05:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='539e02b4366e46878557f18ea375a24a',ramdisk_id='',reservation_id='r-1x1u7hbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1450919923',owner_user_name='tempest-AttachVolumeTestJSON-1450919923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95b00fbf38d4d9b852837c31a4cca68',uuid=9de853a9-19ac-44d9-a9bc-768d6261c235,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converting VIF {"id": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "address": "fa:16:3e:10:f2:a6", "network": {"id": "afc470e7-aecf-4566-8f58-cdb76a66fb31", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-609768984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539e02b4366e46878557f18ea375a24a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84839b11-70", "ovs_interfaceid": "84839b11-70ab-47e4-b2d2-5e3b170ac7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=84839b11-70ab-47e4-b2d2-5e3b170ac7ec,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84839b11-70') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG os_vif [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=84839b11-70ab-47e4-b2d2-5e3b170ac7ec,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84839b11-70') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84839b11-70, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba6408a6-5625-451c-a78c-8bfc1743a78d) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:08:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:08:38 user nova-compute[75203]: INFO os_vif [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=84839b11-70ab-47e4-b2d2-5e3b170ac7ec,network=Network(afc470e7-aecf-4566-8f58-cdb76a66fb31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84839b11-70')
Nov 28 19:08:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Deleting instance files /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235_del
Nov 28 19:08:38 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Deletion of /opt/stack/data/nova/instances/9de853a9-19ac-44d9-a9bc-768d6261c235_del complete
Nov 28 19:08:39 user nova-compute[75203]: INFO nova.compute.manager [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 28 19:08:39 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG nova.objects.instance [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'flavor' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-62eb2101-cff3-435d-9280-3c74d4ca735c tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.634s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:08:40 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Took 1.15 seconds to deallocate network for instance.
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:40 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Deleted allocations for instance 9de853a9-19ac-44d9-a9bc-768d6261c235
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:08:40 user nova-compute[75203]: WARNING nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received unexpected event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with vm_state deleted and task_state None.
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:08:40 user nova-compute[75203]: WARNING nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received unexpected event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with vm_state deleted and task_state None.
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:08:40 user nova-compute[75203]: WARNING nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received unexpected event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with vm_state deleted and task_state None.
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-unplugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-unplugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:08:40 user nova-compute[75203]: WARNING nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received unexpected event network-vif-unplugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with vm_state deleted and task_state None.
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Acquiring lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] No waiting events found dispatching network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:08:40 user nova-compute[75203]: WARNING nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received unexpected event network-vif-plugged-84839b11-70ab-47e4-b2d2-5e3b170ac7ec for instance with vm_state deleted and task_state None.
Nov 28 19:08:40 user nova-compute[75203]: DEBUG nova.compute.manager [req-e2db7244-1ee7-4b80-8bbe-94d0d48d8d5f req-6083c9de-7411-42a5-ac1f-bfac48da0295 service nova] [instance: 9de853a9-19ac-44d9-a9bc-768d6261c235] Received event network-vif-deleted-84839b11-70ab-47e4-b2d2-5e3b170ac7ec {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:08:40 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-6b933b7d-1f0f-4f3d-a764-e33d437a9f95 tempest-AttachVolumeTestJSON-1450919923 tempest-AttachVolumeTestJSON-1450919923-project-member] Lock "9de853a9-19ac-44d9-a9bc-768d6261c235" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.380s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:08:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:08:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:08:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:08:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:08:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:08:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:09:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:09:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:09:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:09:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:09:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:04 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:05 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:05 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:05 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:09:05 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:09:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:09:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=24.965816497802734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8386807e-76ec-46b2-90e7-8391806f89c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 325cbd77-1799-44f6-9b96-17f8a93b53b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:09:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:09:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:09 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:11 user nova-compute[75203]: INFO nova.compute.manager [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Terminating instance
Nov 28 19:09:11 user nova-compute[75203]: DEBUG nova.compute.manager [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-579d32fd-f984-488a-b8f8-2c296b8726ac req-5e6de1d7-59a0-4a40-927c-7926b02127b9 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-unplugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-579d32fd-f984-488a-b8f8-2c296b8726ac req-5e6de1d7-59a0-4a40-927c-7926b02127b9 service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-579d32fd-f984-488a-b8f8-2c296b8726ac req-5e6de1d7-59a0-4a40-927c-7926b02127b9 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-579d32fd-f984-488a-b8f8-2c296b8726ac req-5e6de1d7-59a0-4a40-927c-7926b02127b9 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-579d32fd-f984-488a-b8f8-2c296b8726ac req-5e6de1d7-59a0-4a40-927c-7926b02127b9 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-unplugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-579d32fd-f984-488a-b8f8-2c296b8726ac req-5e6de1d7-59a0-4a40-927c-7926b02127b9 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-unplugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:12 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Instance destroyed successfully.
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'resources' on Instance uuid 8386807e-76ec-46b2-90e7-8391806f89c8 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-616332968',display_name='tempest-TestMinimumBasicScenario-server-616332968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-616332968',id=42,image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFOCpnB2b6DnSfoXsaqVLA3cdnNrL+wCW0k48+vaNwoDvNtXFSbiohAOXMOFTW/XAQNFDWcEIAJy707gWTctIFdyTpGufAZqZjbkBC+g9IqZkoif0H95gTL4udJNIII3w==',key_name='tempest-TestMinimumBasicScenario-1036669470',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:04:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-y5h8vpmi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f01c7807-d9ab-44a2-ac4b-9864fe5f51ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:06:33Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=8386807e-76ec-46b2-90e7-8391806f89c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "address": "fa:16:3e:c6:0e:27", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31aa148f-3b", "ovs_interfaceid": "31aa148f-3bea-4cc9-98f1-2e21a160c25c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG os_vif [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31aa148f-3b, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8761a345-3857-419b-aa45-d6973b9f5e4b) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:12 user nova-compute[75203]: INFO os_vif [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:0e:27,bridge_name='br-int',has_traffic_filtering=True,id=31aa148f-3bea-4cc9-98f1-2e21a160c25c,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31aa148f-3b')
Nov 28 19:09:12 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Deleting instance files /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8_del
Nov 28 19:09:12 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Deletion of /opt/stack/data/nova/instances/8386807e-76ec-46b2-90e7-8391806f89c8_del complete
Nov 28 19:09:12 user nova-compute[75203]: INFO nova.compute.manager [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 19:09:12 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Skipping network cache update for instance because it is being deleted. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:09:12 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:09:13 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Took 0.68 seconds to deallocate network for instance.
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-130936d5-ab81-4a8f-bb1a-cd1410a81a6b req-f009985c-4887-4851-a39c-ea4fb35f6244 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-deleted-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:09:13 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Deleted allocations for instance 8386807e-76ec-46b2-90e7-8391806f89c8
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-10ea48b2-3686-4748-9d86-657658e42a67 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "8386807e-76ec-46b2-90e7-8391806f89c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.909s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-24b0607c-3ef8-49f6-b664-4bb8aa3c35ae req-33570286-cc4e-419e-affc-4306ccffd987 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-24b0607c-3ef8-49f6-b664-4bb8aa3c35ae req-33570286-cc4e-419e-affc-4306ccffd987 service nova] Acquiring lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-24b0607c-3ef8-49f6-b664-4bb8aa3c35ae req-33570286-cc4e-419e-affc-4306ccffd987 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-24b0607c-3ef8-49f6-b664-4bb8aa3c35ae req-33570286-cc4e-419e-affc-4306ccffd987 service nova] Lock "8386807e-76ec-46b2-90e7-8391806f89c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-24b0607c-3ef8-49f6-b664-4bb8aa3c35ae req-33570286-cc4e-419e-affc-4306ccffd987 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] No waiting events found dispatching network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:13 user nova-compute[75203]: WARNING nova.compute.manager [req-24b0607c-3ef8-49f6-b664-4bb8aa3c35ae req-33570286-cc4e-419e-affc-4306ccffd987 service nova] [instance: 8386807e-76ec-46b2-90e7-8391806f89c8] Received unexpected event network-vif-plugged-31aa148f-3bea-4cc9-98f1-2e21a160c25c for instance with vm_state deleted and task_state None.
Nov 28 19:09:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-changed-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing instance network info cache due to event network-changed-214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:09:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] Acquiring lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:09:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] Acquired lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:09:21 user nova-compute[75203]: DEBUG nova.network.neutron [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Refreshing network info cache for port 214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:22 user nova-compute[75203]: INFO nova.compute.manager [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Terminating instance
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-e683073e-e1a9-4974-a56c-6c97146f3f3d req-b94538e2-0d2e-4b61-91dd-0902dbf4df52 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e683073e-e1a9-4974-a56c-6c97146f3f3d req-b94538e2-0d2e-4b61-91dd-0902dbf4df52 service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e683073e-e1a9-4974-a56c-6c97146f3f3d req-b94538e2-0d2e-4b61-91dd-0902dbf4df52 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e683073e-e1a9-4974-a56c-6c97146f3f3d req-b94538e2-0d2e-4b61-91dd-0902dbf4df52 service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-e683073e-e1a9-4974-a56c-6c97146f3f3d req-b94538e2-0d2e-4b61-91dd-0902dbf4df52 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-e683073e-e1a9-4974-a56c-6c97146f3f3d req-b94538e2-0d2e-4b61-91dd-0902dbf4df52 service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updated VIF entry in instance network info cache for port 214e9746-a41c-4671-b7de-d89039d075af. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [{"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-68f6b924-fdfa-4a59-886b-3336097dd33c req-47ca97b2-9ea6-4267-85ce-1fe4e885765d service nova] Releasing lock "refresh_cache-325cbd77-1799-44f6-9b96-17f8a93b53b0" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Instance destroyed successfully.
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lazy-loading 'resources' on Instance uuid 325cbd77-1799-44f6-9b96-17f8a93b53b0 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-28T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1385744915',display_name='tempest-TestShelveInstance-server-1385744915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1385744915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRh4JdcBo385d0nD/g5oN45fbhwg49RMQ1/ZZbKjFeVJzI1vPMZVJrpqSwOy53Ov3kbOTl1+G8PRAmqvSqLiiibWbZXP30iMXyrQxGvsfw/Ds4FdTuaPGauJirY7UlGfw==',key_name='tempest-TestShelveInstance-1256305827',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:07:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b7e2cd3ffb24750b81033db41a35a4d',ramdisk_id='',reservation_id='r-zal341xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-865744978',owner_user_name='tempest-TestShelveInstance-865744978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:07:44Z,user_data=None,user_id='c7545511dc1d4fa5ba723a110312fa4f',uuid=325cbd77-1799-44f6-9b96-17f8a93b53b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converting VIF {"id": "214e9746-a41c-4671-b7de-d89039d075af", "address": "fa:16:3e:de:6e:1b", "network": {"id": "dd345f1b-3f80-411a-9495-c77a3a0aabf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-780943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b7e2cd3ffb24750b81033db41a35a4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap214e9746-a4", "ovs_interfaceid": "214e9746-a41c-4671-b7de-d89039d075af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_vif [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap214e9746-a4, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79785243-0e75-4057-ba4e-b5b143a33953) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:22 user nova-compute[75203]: INFO os_vif [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:6e:1b,bridge_name='br-int',has_traffic_filtering=True,id=214e9746-a41c-4671-b7de-d89039d075af,network=Network(dd345f1b-3f80-411a-9495-c77a3a0aabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap214e9746-a4')
Nov 28 19:09:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JINpHSes', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:09:22 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff9ae7-870c-4296-8922-e7b8b3bd6f3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:09:22 user nova-compute[75203]: No targets found.
Nov 28 19:09:22 user nova-compute[75203]: iSNS:
Nov 28 19:09:22 user nova-compute[75203]: No targets found.
Nov 28 19:09:22 user nova-compute[75203]: STATIC:
Nov 28 19:09:22 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452
Nov 28 19:09:22 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:09:22 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:09:22 user nova-compute[75203]: FIRMWARE:
Nov 28 19:09:22 user nova-compute[75203]: No targets found.
Nov 28 19:09:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:09:22 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:09:22 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c520058-7703-4a79-8e85-e7ea6024d84a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfd824b-b8d2-458c-849d-9a2a9794298e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:09:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 (non-flash)
Nov 28 19:09:22 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07ac32d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452'): ({'sdd'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Removing single pathed devices sdd {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:09:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1123ebb8-34d6-49e1-aaa7-bf6ee065a188]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc289fc-a3c4-48bf-b24a-9d218c577cf1]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Flushing IO for device /dev/sdd {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4897960c-4f53-4540-b23e-2355e18ce559]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b80ffc-d454-40aa-b3f6-452e420e8e89]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] SCSI volumes sdd have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[90361c14-af08-4f64-8993-48a50f9a7218]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd143f-1ca7-4bab-84a5-24ec0798962b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260]
Nov 28 19:09:23 user nova-compute[75203]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452, portal: 172.16.0.220,3260] successful.
Nov 28 19:09:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d907e48-caa5-4a73-9e63-bd353480e452 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffb2d08-8e07-42a8-ae4b-02674fa9c8c2]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] <== disconnect_volume: return (329ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:09:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Deleting instance files /opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0_del
Nov 28 19:09:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Deletion of /opt/stack/data/nova/instances/325cbd77-1799-44f6-9b96-17f8a93b53b0_del complete
Nov 28 19:09:23 user nova-compute[75203]: INFO nova.compute.manager [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 28 19:09:23 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:09:23 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Took 0.44 seconds to deallocate network for instance.
Nov 28 19:09:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-ff7d3700-c112-4bf9-88e7-67ebe3942277 req-8f96da12-6b91-4bb8-9e62-3e8523f72c5f service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-deleted-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:24 user nova-compute[75203]: WARNING nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state deleting.
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:24 user nova-compute[75203]: WARNING nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state deleting.
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:24 user nova-compute[75203]: WARNING nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state deleting.
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-unplugged-214e9746-a41c-4671-b7de-d89039d075af for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Acquiring lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] No waiting events found dispatching network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:09:24 user nova-compute[75203]: WARNING nova.compute.manager [req-f5fcea82-853a-4ca7-980b-ee15db779889 req-971cd3c5-9e0e-4f19-a5f4-bbd3ba7d314a service nova] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Received unexpected event network-vif-plugged-214e9746-a41c-4671-b7de-d89039d075af for instance with vm_state active and task_state deleting.
Nov 28 19:09:24 user nova-compute[75203]: INFO nova.compute.manager [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Took 0.74 seconds to detach 1 volumes for instance.
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] [instance: 325cbd77-1799-44f6-9b96-17f8a93b53b0] Deleting volume: 1d907e48-caa5-4a73-9e63-bd353480e452 {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:24 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Deleted allocations for instance 325cbd77-1799-44f6-9b96-17f8a93b53b0
Nov 28 19:09:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1fa751e2-6c02-4b33-a622-bdab005656cf tempest-TestShelveInstance-865744978 tempest-TestShelveInstance-865744978-project-member] Lock "325cbd77-1799-44f6-9b96-17f8a93b53b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:09:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:09:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:09:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:09:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:10:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:05 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:10:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:10:06 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9053MB free_disk=25.002479553222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b03540f6-e447-442d-b03b-d21b121bf5a1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.196s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:10:06 user nova-compute[75203]: INFO nova.compute.claims [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Claim successful on node user
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.network.neutron [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:10:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.policy [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5327ccb36afb440396c9228baa2fb85d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478ac7f43b8c49abb6b7497869905748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:10:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Creating image(s)
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "/opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "/opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "/opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "ec398f7a32dc459af96c0bdda75c4260add17e33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "ec398f7a32dc459af96c0bdda75c4260add17e33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG nova.virt.images [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] e6285cf6-1dca-49e4-877c-d75661bcffb8 was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.part /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.part /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.converted" returned: 0 in 0.337s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:07 user nova-compute[75203]: DEBUG nova.network.neutron [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Successfully created port: b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "ec398f7a32dc459af96c0bdda75c4260add17e33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.232s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33 --force-share --output=json" returned: 0 in 0.183s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "ec398f7a32dc459af96c0bdda75c4260add17e33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "ec398f7a32dc459af96c0bdda75c4260add17e33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33 --force-share --output=json" returned: 0 in 0.171s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33,backing_fmt=raw /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33,backing_fmt=raw /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk 1073741824" returned: 0 in 0.066s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "ec398f7a32dc459af96c0bdda75c4260add17e33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33 --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.network.neutron [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Successfully updated port: b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.compute.manager [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing instance network info cache due to event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.network.neutron [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33 --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Cannot resize image /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Ensure instance console log exists: /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.neutron [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7f9725d1-7b57-472d-8fd8-657fc9309c5b req-3800e850-2372-4dbc-ad68-d629cc78f065 service nova] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.neutron [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance network_info: |[{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Start _get_guest_xml network_info=[{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T19:10:03Z,direct_url=<?>,disk_format='qcow2',id=e6285cf6-1dca-49e4-877c-d75661bcffb8,min_disk=0,min_ram=0,name='tempest-scenario-img--875309259',owner='478ac7f43b8c49abb6b7497869905748',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T19:10:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'e6285cf6-1dca-49e4-877c-d75661bcffb8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:10:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:10:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T19:10:03Z,direct_url=<?>,disk_format='qcow2',id=e6285cf6-1dca-49e4-877c-d75661bcffb8,min_disk=0,min_ram=0,name='tempest-scenario-img--875309259',owner='478ac7f43b8c49abb6b7497869905748',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T19:10:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2029002490',display_name='tempest-TestMinimumBasicScenario-server-2029002490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2029002490',id=44,image_ref='e6285cf6-1dca-49e4-877c-d75661bcffb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMWSXG+SdTLLHYsGdV4qhtlWtp2ULFChzjPUtFoEa45wt2Z6StL8poXSLHrBrn/jG71JBe7QDAYz3LutjyT8chZUyDUTsbFY0bXWmvLlpKfr3AUue1zKLuViG+Gk2hw0Q==',key_name='tempest-TestMinimumBasicScenario-1157042087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-awe86fb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6285cf6-1dca-49e4-877c-d75661bcffb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:10:07Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=b03540f6-e447-442d-b03b-d21b121bf5a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:71:97,bridge_name='br-int',has_traffic_filtering=True,id=b69adcda-86cd-4f02-8db1-f7f53efbc446,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69adcda-86') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.objects.instance [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'pci_devices' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:10:09 user nova-compute[75203]:   <uuid>b03540f6-e447-442d-b03b-d21b121bf5a1</uuid>
Nov 28 19:10:09 user nova-compute[75203]:   <name>instance-0000002c</name>
Nov 28 19:10:09 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:10:09 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:10:09 user nova-compute[75203]:   <metadata>
Nov 28 19:10:09 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:10:09 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:10:09 user nova-compute[75203]:       <nova:name>tempest-TestMinimumBasicScenario-server-2029002490</nova:name>
Nov 28 19:10:09 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:10:09</nova:creationTime>
Nov 28 19:10:09 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:10:09 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:10:09 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:10:09 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:10:09 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:10:09 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:10:09 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:10:09 user nova-compute[75203]:       <nova:owner>
Nov 28 19:10:09 user nova-compute[75203]:         <nova:user uuid="5327ccb36afb440396c9228baa2fb85d">tempest-TestMinimumBasicScenario-710384277-project-member</nova:user>
Nov 28 19:10:09 user nova-compute[75203]:         <nova:project uuid="478ac7f43b8c49abb6b7497869905748">tempest-TestMinimumBasicScenario-710384277</nova:project>
Nov 28 19:10:09 user nova-compute[75203]:       </nova:owner>
Nov 28 19:10:09 user nova-compute[75203]:       <nova:root type="image" uuid="e6285cf6-1dca-49e4-877c-d75661bcffb8"/>
Nov 28 19:10:09 user nova-compute[75203]:       <nova:ports>
Nov 28 19:10:09 user nova-compute[75203]:         <nova:port uuid="b69adcda-86cd-4f02-8db1-f7f53efbc446">
Nov 28 19:10:09 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 19:10:09 user nova-compute[75203]:         </nova:port>
Nov 28 19:10:09 user nova-compute[75203]:       </nova:ports>
Nov 28 19:10:09 user nova-compute[75203]:     </nova:instance>
Nov 28 19:10:09 user nova-compute[75203]:   </metadata>
Nov 28 19:10:09 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:10:09 user nova-compute[75203]:     <system>
Nov 28 19:10:09 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:10:09 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:10:09 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:10:09 user nova-compute[75203]:       <entry name="serial">b03540f6-e447-442d-b03b-d21b121bf5a1</entry>
Nov 28 19:10:09 user nova-compute[75203]:       <entry name="uuid">b03540f6-e447-442d-b03b-d21b121bf5a1</entry>
Nov 28 19:10:09 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:10:09 user nova-compute[75203]:     </system>
Nov 28 19:10:09 user nova-compute[75203]:   </sysinfo>
Nov 28 19:10:09 user nova-compute[75203]:   <os>
Nov 28 19:10:09 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:10:09 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:10:09 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:10:09 user nova-compute[75203]:   </os>
Nov 28 19:10:09 user nova-compute[75203]:   <features>
Nov 28 19:10:09 user nova-compute[75203]:     <acpi/>
Nov 28 19:10:09 user nova-compute[75203]:     <apic/>
Nov 28 19:10:09 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:10:09 user nova-compute[75203]:   </features>
Nov 28 19:10:09 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:10:09 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:10:09 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:10:09 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:10:09 user nova-compute[75203]:   </clock>
Nov 28 19:10:09 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:10:09 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:10:09 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:10:09 user nova-compute[75203]:   </cpu>
Nov 28 19:10:09 user nova-compute[75203]:   <devices>
Nov 28 19:10:09 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:10:09 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:10:09 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk"/>
Nov 28 19:10:09 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:10:09 user nova-compute[75203]:     </disk>
Nov 28 19:10:09 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:10:09 user nova-compute[75203]:       <mac address="fa:16:3e:71:71:97"/>
Nov 28 19:10:09 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:10:09 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:10:09 user nova-compute[75203]:       <target dev="tapb69adcda-86"/>
Nov 28 19:10:09 user nova-compute[75203]:     </interface>
Nov 28 19:10:09 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:10:09 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/console.log" append="off"/>
Nov 28 19:10:09 user nova-compute[75203]:     </serial>
Nov 28 19:10:09 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:10:09 user nova-compute[75203]:     <video>
Nov 28 19:10:09 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:10:09 user nova-compute[75203]:     </video>
Nov 28 19:10:09 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:10:09 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:10:09 user nova-compute[75203]:     </rng>
Nov 28 19:10:09 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:10:09 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:10:09 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:10:09 user nova-compute[75203]:     </memballoon>
Nov 28 19:10:09 user nova-compute[75203]:   </devices>
Nov 28 19:10:09 user nova-compute[75203]: </domain>
Nov 28 19:10:09 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2029002490',display_name='tempest-TestMinimumBasicScenario-server-2029002490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2029002490',id=44,image_ref='e6285cf6-1dca-49e4-877c-d75661bcffb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMWSXG+SdTLLHYsGdV4qhtlWtp2ULFChzjPUtFoEa45wt2Z6StL8poXSLHrBrn/jG71JBe7QDAYz3LutjyT8chZUyDUTsbFY0bXWmvLlpKfr3AUue1zKLuViG+Gk2hw0Q==',key_name='tempest-TestMinimumBasicScenario-1157042087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-awe86fb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6285cf6-1dca-49e4-877c-d75661bcffb8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:10:07Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=b03540f6-e447-442d-b03b-d21b121bf5a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:71:97,bridge_name='br-int',has_traffic_filtering=True,id=b69adcda-86cd-4f02-8db1-f7f53efbc446,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69adcda-86') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG os_vif [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:71:97,bridge_name='br-int',has_traffic_filtering=True,id=b69adcda-86cd-4f02-8db1-f7f53efbc446,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69adcda-86') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cd18436-b9d2-58cb-aecf-031c19828df7', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb69adcda-86, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb69adcda-86, col_values=(('qos', UUID('0a0928f1-1fe6-4603-95a6-33f086c37ada')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb69adcda-86, col_values=(('external_ids', {'iface-id': 'b69adcda-86cd-4f02-8db1-f7f53efbc446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:71:97', 'vm-uuid': 'b03540f6-e447-442d-b03b-d21b121bf5a1'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:09 user nova-compute[75203]: INFO os_vif [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:71:97,bridge_name='br-int',has_traffic_filtering=True,id=b69adcda-86cd-4f02-8db1-f7f53efbc446,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69adcda-86')
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:10:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No VIF found with MAC fa:16:3e:71:71:97, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:10:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-7014b804-f2d4-44ba-ae5e-4d81e4c3a2c6 req-6f4b29e9-4f6e-4800-91aa-e9c4e80ad7b8 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:10:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7014b804-f2d4-44ba-ae5e-4d81e4c3a2c6 req-6f4b29e9-4f6e-4800-91aa-e9c4e80ad7b8 service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7014b804-f2d4-44ba-ae5e-4d81e4c3a2c6 req-6f4b29e9-4f6e-4800-91aa-e9c4e80ad7b8 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7014b804-f2d4-44ba-ae5e-4d81e4c3a2c6 req-6f4b29e9-4f6e-4800-91aa-e9c4e80ad7b8 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-7014b804-f2d4-44ba-ae5e-4d81e4c3a2c6 req-6f4b29e9-4f6e-4800-91aa-e9c4e80ad7b8 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:10:12 user nova-compute[75203]: WARNING nova.compute.manager [req-7014b804-f2d4-44ba-ae5e-4d81e4c3a2c6 req-6f4b29e9-4f6e-4800-91aa-e9c4e80ad7b8 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received unexpected event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with vm_state building and task_state spawning.
Nov 28 19:10:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:10:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance spawned successfully.
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:13 user nova-compute[75203]: INFO nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 28 19:10:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:10:13 user nova-compute[75203]: INFO nova.compute.manager [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Took 7.14 seconds to build instance.
Nov 28 19:10:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-605ff7e7-c344-4eb0-ae25-055932de038e tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.538s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-e874ff7f-be83-444d-9cdd-5b2e8f757e41 req-5ad7b0ab-c442-40c9-81db-1317e1d0c7a0 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e874ff7f-be83-444d-9cdd-5b2e8f757e41 req-5ad7b0ab-c442-40c9-81db-1317e1d0c7a0 service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e874ff7f-be83-444d-9cdd-5b2e8f757e41 req-5ad7b0ab-c442-40c9-81db-1317e1d0c7a0 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-e874ff7f-be83-444d-9cdd-5b2e8f757e41 req-5ad7b0ab-c442-40c9-81db-1317e1d0c7a0 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-e874ff7f-be83-444d-9cdd-5b2e8f757e41 req-5ad7b0ab-c442-40c9-81db-1317e1d0c7a0 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:10:14 user nova-compute[75203]: WARNING nova.compute.manager [req-e874ff7f-be83-444d-9cdd-5b2e8f757e41 req-5ad7b0ab-c442-40c9-81db-1317e1d0c7a0 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received unexpected event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with vm_state active and task_state None.
Nov 28 19:10:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:14 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:10:14 user nova-compute[75203]: INFO nova.compute.claims [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Claim successful on node user
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.network.neutron [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:10:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.policy [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06d11170e91342349efb7e344ab6aee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e871dfa632b44069bb1ee21226f7fb3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:10:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Creating image(s)
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "/opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "/opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "/opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "325f4d17ae81b876601678107eacbf8617755a0b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.175s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk 1073741824" returned: 0 in 0.055s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "325f4d17ae81b876601678107eacbf8617755a0b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk. size=1073741824 {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.network.neutron [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Successfully created port: 1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.virt.disk.api [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Cannot resize image /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk to a smaller size. {{(pid=75203) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Ensure instance console log exists: /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.network.neutron [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Successfully updated port: 1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquired lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.network.neutron [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-changed-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Refreshing instance network info cache due to event network-changed-1cad9850-3744-41be-869c-16bb5a0dc31d. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] Acquiring lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:10:16 user nova-compute[75203]: DEBUG nova.network.neutron [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.neutron [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Releasing lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Instance network_info: |[{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] Acquired lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Refreshing network info cache for port 1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Start _get_guest_xml network_info=[{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '6c841bc3-8129-43e8-9397-445eaf245bad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:10:17 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:10:17 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-28T18:31:00Z,direct_url=<?>,disk_format='qcow2',id=6c841bc3-8129-43e8-9397-445eaf245bad,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6314a56936bd44e8891984d3a2469aea',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-28T18:31:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1597976167',display_name='tempest-TestStampPattern-server-1597976167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1597976167',id=45,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjwXoVTXx3g1WMBTPVc3BXkuMemAGX8TzrRf6HtBtdLY/dN3tE8aN/Oy01QY+z7r8d1veP5x5qdzjPkRsvcN2rOC0Z6T1lLPx56vti7hCdJ2gyz4CzO3SnKHdFISjBeQA==',key_name='tempest-TestStampPattern-775410057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e871dfa632b44069bb1ee21226f7fb3a',ramdisk_id='',reservation_id='r-lp4w0xe8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-20479436',owner_user_name='tempest-TestStampPattern-20479436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:10:15Z,user_data=None,user_id='06d11170e91342349efb7e344ab6aee8',uuid=8414cd04-d905-4e89-a572-0c28aee7f515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converting VIF {"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f1:8a,bridge_name='br-int',has_traffic_filtering=True,id=1cad9850-3744-41be-869c-16bb5a0dc31d,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cad9850-37') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.objects.instance [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'pci_devices' on Instance uuid 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:10:17 user nova-compute[75203]:   <uuid>8414cd04-d905-4e89-a572-0c28aee7f515</uuid>
Nov 28 19:10:17 user nova-compute[75203]:   <name>instance-0000002d</name>
Nov 28 19:10:17 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:10:17 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:10:17 user nova-compute[75203]:   <metadata>
Nov 28 19:10:17 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:10:17 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:10:17 user nova-compute[75203]:       <nova:name>tempest-TestStampPattern-server-1597976167</nova:name>
Nov 28 19:10:17 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:10:17</nova:creationTime>
Nov 28 19:10:17 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:10:17 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:10:17 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:10:17 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:10:17 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:10:17 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:10:17 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:10:17 user nova-compute[75203]:       <nova:owner>
Nov 28 19:10:17 user nova-compute[75203]:         <nova:user uuid="06d11170e91342349efb7e344ab6aee8">tempest-TestStampPattern-20479436-project-member</nova:user>
Nov 28 19:10:17 user nova-compute[75203]:         <nova:project uuid="e871dfa632b44069bb1ee21226f7fb3a">tempest-TestStampPattern-20479436</nova:project>
Nov 28 19:10:17 user nova-compute[75203]:       </nova:owner>
Nov 28 19:10:17 user nova-compute[75203]:       <nova:root type="image" uuid="6c841bc3-8129-43e8-9397-445eaf245bad"/>
Nov 28 19:10:17 user nova-compute[75203]:       <nova:ports>
Nov 28 19:10:17 user nova-compute[75203]:         <nova:port uuid="1cad9850-3744-41be-869c-16bb5a0dc31d">
Nov 28 19:10:17 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 28 19:10:17 user nova-compute[75203]:         </nova:port>
Nov 28 19:10:17 user nova-compute[75203]:       </nova:ports>
Nov 28 19:10:17 user nova-compute[75203]:     </nova:instance>
Nov 28 19:10:17 user nova-compute[75203]:   </metadata>
Nov 28 19:10:17 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:10:17 user nova-compute[75203]:     <system>
Nov 28 19:10:17 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:10:17 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:10:17 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:10:17 user nova-compute[75203]:       <entry name="serial">8414cd04-d905-4e89-a572-0c28aee7f515</entry>
Nov 28 19:10:17 user nova-compute[75203]:       <entry name="uuid">8414cd04-d905-4e89-a572-0c28aee7f515</entry>
Nov 28 19:10:17 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:10:17 user nova-compute[75203]:     </system>
Nov 28 19:10:17 user nova-compute[75203]:   </sysinfo>
Nov 28 19:10:17 user nova-compute[75203]:   <os>
Nov 28 19:10:17 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:10:17 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:10:17 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:10:17 user nova-compute[75203]:   </os>
Nov 28 19:10:17 user nova-compute[75203]:   <features>
Nov 28 19:10:17 user nova-compute[75203]:     <acpi/>
Nov 28 19:10:17 user nova-compute[75203]:     <apic/>
Nov 28 19:10:17 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:10:17 user nova-compute[75203]:   </features>
Nov 28 19:10:17 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:10:17 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:10:17 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:10:17 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:10:17 user nova-compute[75203]:   </clock>
Nov 28 19:10:17 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:10:17 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:10:17 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:10:17 user nova-compute[75203]:   </cpu>
Nov 28 19:10:17 user nova-compute[75203]:   <devices>
Nov 28 19:10:17 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:10:17 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:10:17 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk"/>
Nov 28 19:10:17 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:10:17 user nova-compute[75203]:     </disk>
Nov 28 19:10:17 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:10:17 user nova-compute[75203]:       <mac address="fa:16:3e:f0:f1:8a"/>
Nov 28 19:10:17 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:10:17 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:10:17 user nova-compute[75203]:       <target dev="tap1cad9850-37"/>
Nov 28 19:10:17 user nova-compute[75203]:     </interface>
Nov 28 19:10:17 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:10:17 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/console.log" append="off"/>
Nov 28 19:10:17 user nova-compute[75203]:     </serial>
Nov 28 19:10:17 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:10:17 user nova-compute[75203]:     <video>
Nov 28 19:10:17 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:10:17 user nova-compute[75203]:     </video>
Nov 28 19:10:17 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:10:17 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:10:17 user nova-compute[75203]:     </rng>
Nov 28 19:10:17 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:10:17 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:10:17 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:10:17 user nova-compute[75203]:     </memballoon>
Nov 28 19:10:17 user nova-compute[75203]:   </devices>
Nov 28 19:10:17 user nova-compute[75203]: </domain>
Nov 28 19:10:17 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1597976167',display_name='tempest-TestStampPattern-server-1597976167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1597976167',id=45,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjwXoVTXx3g1WMBTPVc3BXkuMemAGX8TzrRf6HtBtdLY/dN3tE8aN/Oy01QY+z7r8d1veP5x5qdzjPkRsvcN2rOC0Z6T1lLPx56vti7hCdJ2gyz4CzO3SnKHdFISjBeQA==',key_name='tempest-TestStampPattern-775410057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e871dfa632b44069bb1ee21226f7fb3a',ramdisk_id='',reservation_id='r-lp4w0xe8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-20479436',owner_user_name='tempest-TestStampPattern-20479436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:10:15Z,user_data=None,user_id='06d11170e91342349efb7e344ab6aee8',uuid=8414cd04-d905-4e89-a572-0c28aee7f515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converting VIF {"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f1:8a,bridge_name='br-int',has_traffic_filtering=True,id=1cad9850-3744-41be-869c-16bb5a0dc31d,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cad9850-37') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG os_vif [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f1:8a,bridge_name='br-int',has_traffic_filtering=True,id=1cad9850-3744-41be-869c-16bb5a0dc31d,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cad9850-37') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1e76a5d-7946-5b69-be91-b50e37e8c987', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cad9850-37, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cad9850-37, col_values=(('qos', UUID('1ede9419-0a4d-4465-ac13-627b7d272ef2')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cad9850-37, col_values=(('external_ids', {'iface-id': '1cad9850-3744-41be-869c-16bb5a0dc31d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:f1:8a', 'vm-uuid': '8414cd04-d905-4e89-a572-0c28aee7f515'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:17 user nova-compute[75203]: INFO os_vif [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f1:8a,bridge_name='br-int',has_traffic_filtering=True,id=1cad9850-3744-41be-869c-16bb5a0dc31d,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cad9850-37')
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No VIF found with MAC fa:16:3e:f0:f1:8a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updated VIF entry in instance network info cache for port 1cad9850-3744-41be-869c-16bb5a0dc31d. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG nova.network.neutron [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:10:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8b96f47f-b270-40c0-b169-7b09af1559ab req-d854b0dd-b0af-421f-b72d-1c81934bdb11 service nova] Releasing lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-a1cf5bbd-89fc-4277-af35-e155225b902d req-51d53174-bafc-4aec-b308-8b1db442e067 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a1cf5bbd-89fc-4277-af35-e155225b902d req-51d53174-bafc-4aec-b308-8b1db442e067 service nova] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a1cf5bbd-89fc-4277-af35-e155225b902d req-51d53174-bafc-4aec-b308-8b1db442e067 service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a1cf5bbd-89fc-4277-af35-e155225b902d req-51d53174-bafc-4aec-b308-8b1db442e067 service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-a1cf5bbd-89fc-4277-af35-e155225b902d req-51d53174-bafc-4aec-b308-8b1db442e067 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] No waiting events found dispatching network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:10:18 user nova-compute[75203]: WARNING nova.compute.manager [req-a1cf5bbd-89fc-4277-af35-e155225b902d req-51d53174-bafc-4aec-b308-8b1db442e067 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received unexpected event network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d for instance with vm_state building and task_state spawning.
Nov 28 19:10:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:10:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Instance spawned successfully.
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:10:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-b7c9fe36-ab3e-4846-bab1-2a2966687b30 req-321a7140-0f3d-4b38-84b6-9a62c7feea14 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:10:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b7c9fe36-ab3e-4846-bab1-2a2966687b30 req-321a7140-0f3d-4b38-84b6-9a62c7feea14 service nova] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b7c9fe36-ab3e-4846-bab1-2a2966687b30 req-321a7140-0f3d-4b38-84b6-9a62c7feea14 service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b7c9fe36-ab3e-4846-bab1-2a2966687b30 req-321a7140-0f3d-4b38-84b6-9a62c7feea14 service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-b7c9fe36-ab3e-4846-bab1-2a2966687b30 req-321a7140-0f3d-4b38-84b6-9a62c7feea14 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] No waiting events found dispatching network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:10:21 user nova-compute[75203]: WARNING nova.compute.manager [req-b7c9fe36-ab3e-4846-bab1-2a2966687b30 req-321a7140-0f3d-4b38-84b6-9a62c7feea14 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received unexpected event network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d for instance with vm_state building and task_state spawning.
Nov 28 19:10:21 user nova-compute[75203]: INFO nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 28 19:10:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:10:21 user nova-compute[75203]: INFO nova.compute.manager [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Took 6.26 seconds to build instance.
Nov 28 19:10:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-079b20ea-fc31-4a9a-b7b7-c5a3d0484bd9 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.372s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Verify base images {{(pid=75203) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Image id 6c841bc3-8129-43e8-9397-445eaf245bad yields fingerprint 325f4d17ae81b876601678107eacbf8617755a0b {{(pid=75203) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 19:10:31 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] image 6c841bc3-8129-43e8-9397-445eaf245bad at (/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b): checking
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] image 6c841bc3-8129-43e8-9397-445eaf245bad at (/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b): image is in use {{(pid=75203) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75203) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Image id e6285cf6-1dca-49e4-877c-d75661bcffb8 yields fingerprint ec398f7a32dc459af96c0bdda75c4260add17e33 {{(pid=75203) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 28 19:10:31 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] image e6285cf6-1dca-49e4-877c-d75661bcffb8 at (/opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33): checking
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] image e6285cf6-1dca-49e4-877c-d75661bcffb8 at (/opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33): image is in use {{(pid=75203) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] b03540f6-e447-442d-b03b-d21b121bf5a1 is a valid instance name {{(pid=75203) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] b03540f6-e447-442d-b03b-d21b121bf5a1 has a disk file {{(pid=75203) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 19:10:31 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b03540f6-e447-442d-b03b-d21b121bf5a1 is backed by ec398f7a32dc459af96c0bdda75c4260add17e33 {{(pid=75203) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] 8414cd04-d905-4e89-a572-0c28aee7f515 is a valid instance name {{(pid=75203) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] 8414cd04-d905-4e89-a572-0c28aee7f515 has a disk file {{(pid=75203) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 is backed by 325f4d17ae81b876601678107eacbf8617755a0b {{(pid=75203) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 28 19:10:32 user nova-compute[75203]: WARNING nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Unknown base file: /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753
Nov 28 19:10:32 user nova-compute[75203]: WARNING nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Unknown base file: /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d
Nov 28 19:10:32 user nova-compute[75203]: WARNING nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Unknown base file: /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9
Nov 28 19:10:32 user nova-compute[75203]: WARNING nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Unknown base file: /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487
Nov 28 19:10:32 user nova-compute[75203]: WARNING nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Unknown base file: /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1
Nov 28 19:10:32 user nova-compute[75203]: WARNING nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Unknown base file: /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4
Nov 28 19:10:32 user nova-compute[75203]: WARNING nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Unknown base file: /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Active base files: /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b /opt/stack/data/nova/instances/_base/ec398f7a32dc459af96c0bdda75c4260add17e33
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Removable base files: /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753 /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9 /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487 /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1 /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4 /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/493d047dadc87d83ec0e1367a18a7bd67cfee753
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e71934900d5fe337ce08e757cf666adddd5bc61d
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cff3bb99993b5704cc8e365c2a3850f3e3e7a8b9
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/10c1f6a0e9671baf558e1c91ea55fa4546e6a487
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34143111c5ea11a0e2dac5fbbfe487001d4babe1
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/313be65ec5f1bdcbe5f40b661f19b293b14cada4
Nov 28 19:10:32 user nova-compute[75203]: INFO nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b8ebbec09c0566859c39fb4b125a0aa499e5f7eb
Nov 28 19:10:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Verification complete {{(pid=75203) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Verify swap images {{(pid=75203) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 28 19:10:32 user nova-compute[75203]: DEBUG nova.virt.libvirt.imagecache [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Verify ephemeral images {{(pid=75203) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 28 19:10:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:54 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:10:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:10:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:10:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:10:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:10:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:10:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:10:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:10:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:11:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:11:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:11:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:11:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:11:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:11:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:11:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=24.901988983154297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b03540f6-e447-442d-b03b-d21b121bf5a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:11:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:11:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:11:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:11:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:11:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:11:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:11:15 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:11:15 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:11:16 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:11:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:11:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:11:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:11:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:11:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_power_states {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:11:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:11:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:11:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:11:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:11:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:11:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:11:58 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:11:58 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'flavor' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:11:59 user nova-compute[75203]: INFO nova.compute.manager [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Attaching volume 90a51dba-f15c-4ce9-bd37-4d3608012daf to /dev/vdb
Nov 28 19:11:59 user nova-compute[75203]: DEBUG os_brick.utils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc0777c-1d44-4d97-9472-843861e7bb42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39bb48d-80be-4cc7-84d6-061ef29c947e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[197d308a-5b45-4d72-95b9-bdf260647c02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b018d-858f-4cbb-80e2-5e4d84a799b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:11:59 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:11:59 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b930b83-7d8f-4ed7-b284-5f757e508fd6]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG os_brick.utils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:11:59 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating existing volume attachment record: d1d495b1-aa28-4d98-8545-8de2172e4299 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:12:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:12:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:12:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:12:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:12:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKpmWVQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:12:06 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:12:06 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:12:06 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e6fcb1-fa7e-4941-8287-361c71b8a139]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:12:06 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8734d084-a328-4f5e-a510-aa05538368b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf] added
Nov 28 19:12:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf7b5d8-e6f2-415d-be3c-787b0b0a7a48]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[54544f31-b775-4bad-b853-a447c4caa795]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKpmWVQO {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKpmWVQO" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c531d72-0390-43dd-8a83-98e2479c8ac7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKpmWVQO'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44c7a04-6f83-4c42-8764-27f9ad5f62c1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f355f0-d0a3-460c-87f0-dfa335b47c6f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:12:06 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:12:06 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:12:06 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:12:06 user nova-compute[75203]: 
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[76885d4d-67f9-483e-be9d-4f30d72f14bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260]
Nov 28 19:12:06 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260] successful.
Nov 28 19:12:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b778e28c-abad-4deb-ba52-e3c016de3b8f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea3695-b8e9-4ca6-b13a-0beb0246f467]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:06 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b07113-76d3-4ed8-a7be-90bbfbd89424]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKpmWVQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:12:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-changed-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Refreshing instance network info cache due to event network-changed-1cad9850-3744-41be-869c-16bb5a0dc31d. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] Acquiring lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] Acquired lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Refreshing network info cache for port 1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updated VIF entry in instance network info cache for port 1cad9850-3744-41be-869c-16bb5a0dc31d. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ffda8cd2-d0a5-4998-b847-31973ec0be08 req-f79e4b5d-65a4-4e15-88da-753bd2fd21a3 service nova] Releasing lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'flavor' on Instance uuid 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26334356266376666', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334356266376666', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'flavor' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 19:12:07 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:12:07 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:12:07 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:12:07 user nova-compute[75203]:   <serial>90a51dba-f15c-4ce9-bd37-4d3608012daf</serial>
Nov 28 19:12:07 user nova-compute[75203]: </disk>
Nov 28 19:12:07 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:07 user nova-compute[75203]: INFO nova.compute.manager [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Attaching volume 8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b to /dev/vdb
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[148cb242-3310-4326-88f0-926445001488]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[084a29ce-52fa-4ec0-90fd-6192676d3684]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[87905925-ad34-4231-a85e-88f6496af0c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b1a842-2911-49ef-9baa-c60fa15e5e94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:12:07 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:12:07 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d972da07-cec3-4e36-80cd-8093011c41c2]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG os_brick.utils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:12:07 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating existing volume attachment record: f0da856f-1bbf-4b24-a514-e24615b40e32 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] No VIF found with MAC fa:16:3e:71:71:97, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d0e51d37-4dd7-4492-863f-b92472a7fa68 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.081s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:08 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:12:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=24.900989532470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b03540f6-e447-442d-b03b-d21b121bf5a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:12:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing instance network info cache due to event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG nova.network.neutron [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:12:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:11 user nova-compute[75203]: DEBUG nova.network.neutron [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updated VIF entry in instance network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:12:11 user nova-compute[75203]: DEBUG nova.network.neutron [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:12:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9e25d186-93eb-433c-b3ef-6266df019102 req-9b8fef10-f710-4932-8323-6bd88869156f service nova] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:12:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:12:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing instance network info cache due to event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:12:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:12:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:12:12 user nova-compute[75203]: DEBUG nova.network.neutron [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updated VIF entry in instance network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8efb63fa-1949-4e8c-88da-e1e42372bad3 req-87462393-97a7-4aa9-9b3f-4001c25cca85 service nova] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:13 user nova-compute[75203]: INFO nova.compute.manager [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Rebooting instance
Nov 28 19:12:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG nova.network.neutron [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG nova.network.neutron [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:12:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvBgPMUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:12:14 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:12:14 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:12:14 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c2c29f-07a7-44de-827e-64beaeac8140]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:12:14 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4977ec6-8711-4a54-92a9-d20edac15288]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b] added
Nov 28 19:12:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e4ce9-ed88-4bb5-8637-2c0880b2019c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2364b19-59ed-4154-82a0-174be890a61d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CvBgPMUa {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CvBgPMUa" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aa63f5-c33a-475d-88f1-0450f9294fd8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CvBgPMUa'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e16504-f0be-4ed5-a22a-f42e397c5212]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab0e1b-0ee3-4ace-a980-4ce8b9ff3a89]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a30b6-c018-4b66-b7a2-c4d5dd433b2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260]
Nov 28 19:12:14 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260] successful.
Nov 28 19:12:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ef3308-8a14-470d-96b5-a77cfea32d82]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a4235a-dbf2-46df-8556-7f3093eb02ea]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:14 user nova-compute[75203]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b (non-flash)
Nov 28 19:12:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:14 user nova-compute[75203]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b (non-flash)
Nov 28 19:12:14 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a15249e-5020-4a53-aad6-c9f97bdc5d53]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:14 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvBgPMUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23065363465336336', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065363465336336', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'flavor' on Instance uuid 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:12:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 19:12:15 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:12:15 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 19:12:15 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:12:15 user nova-compute[75203]:   <serial>8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b</serial>
Nov 28 19:12:15 user nova-compute[75203]: </disk>
Nov 28 19:12:15 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No VIF found with MAC fa:16:3e:f0:f1:8a, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-366a65c0-69a1-41ce-89a2-b64ef2f145c7 req-81cafd6c-5cb6-48cf-bec0-98d7926723fb service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-unplugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-366a65c0-69a1-41ce-89a2-b64ef2f145c7 req-81cafd6c-5cb6-48cf-bec0-98d7926723fb service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-366a65c0-69a1-41ce-89a2-b64ef2f145c7 req-81cafd6c-5cb6-48cf-bec0-98d7926723fb service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-366a65c0-69a1-41ce-89a2-b64ef2f145c7 req-81cafd6c-5cb6-48cf-bec0-98d7926723fb service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-366a65c0-69a1-41ce-89a2-b64ef2f145c7 req-81cafd6c-5cb6-48cf-bec0-98d7926723fb service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-unplugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:12:16 user nova-compute[75203]: WARNING nova.compute.manager [req-366a65c0-69a1-41ce-89a2-b64ef2f145c7 req-81cafd6c-5cb6-48cf-bec0-98d7926723fb service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received unexpected event network-vif-unplugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with vm_state active and task_state reboot_started.
Nov 28 19:12:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f77272c3-8366-4704-ad37-fd19b7fc277f tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.782s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance shutdown successfully.
Nov 28 19:12:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:12:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:12:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:12:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:12:17 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-f422e3ca-3a71-43cc-abe4-96d632c0edf1 req-9cdae751-6b0d-431f-a5c0-d39a60127d66 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f422e3ca-3a71-43cc-abe4-96d632c0edf1 req-9cdae751-6b0d-431f-a5c0-d39a60127d66 service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f422e3ca-3a71-43cc-abe4-96d632c0edf1 req-9cdae751-6b0d-431f-a5c0-d39a60127d66 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f422e3ca-3a71-43cc-abe4-96d632c0edf1 req-9cdae751-6b0d-431f-a5c0-d39a60127d66 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-f422e3ca-3a71-43cc-abe4-96d632c0edf1 req-9cdae751-6b0d-431f-a5c0-d39a60127d66 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:12:18 user nova-compute[75203]: WARNING nova.compute.manager [req-f422e3ca-3a71-43cc-abe4-96d632c0edf1 req-9cdae751-6b0d-431f-a5c0-d39a60127d66 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received unexpected event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with vm_state active and task_state reboot_started.
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:19 user nova-compute[75203]: INFO nova.compute.manager [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Detaching volume 8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b
Nov 28 19:12:19 user nova-compute[75203]: INFO nova.virt.block_device [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Attempting to driver detach volume 8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b from mountpoint /dev/vdb
Nov 28 19:12:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Attempting to detach device vdb from instance 8414cd04-d905-4e89-a572-0c28aee7f515 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:12:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:12:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:12:19 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 19:12:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:12:19 user nova-compute[75203]:   <serial>8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b</serial>
Nov 28 19:12:19 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:12:19 user nova-compute[75203]: </disk>
Nov 28 19:12:19 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:12:19 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully detached device vdb from instance 8414cd04-d905-4e89-a572-0c28aee7f515 from the persistent domain config.
Nov 28 19:12:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8414cd04-d905-4e89-a572-0c28aee7f515 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:12:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:12:19 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:12:19 user nova-compute[75203]:   <source dev="/dev/sdc"/>
Nov 28 19:12:19 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:12:19 user nova-compute[75203]:   <serial>8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b</serial>
Nov 28 19:12:19 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:12:19 user nova-compute[75203]: </disk>
Nov 28 19:12:19 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:12:19 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:12:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance running successfully.
Nov 28 19:12:20 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance soft rebooted successfully.
Nov 28 19:12:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:12:20 user nova-compute[75203]: WARNING nova.compute.manager [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received unexpected event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with vm_state active and task_state None.
Nov 28 19:12:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:20 user nova-compute[75203]: DEBUG nova.compute.manager [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:12:20 user nova-compute[75203]: WARNING nova.compute.manager [req-da8e51f4-eee5-4dc7-aa8e-f3546b55d6ec req-4c750034-13b1-4e9d-ab6e-28bf4f230654 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received unexpected event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with vm_state active and task_state None.
Nov 28 19:12:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a96a0627-5b7f-4079-afad-33cb28388849 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.121s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:32 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:37 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:39 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8414cd04-d905-4e89-a572-0c28aee7f515 is timed out.
Nov 28 19:12:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully detached device vdb from instance 8414cd04-d905-4e89-a572-0c28aee7f515 from the live domain config.
Nov 28 19:12:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvBgPMUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:12:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3070e5-41c2-4fb1-b949-ec14c04a920a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:12:39 user nova-compute[75203]: No targets found.
Nov 28 19:12:39 user nova-compute[75203]: iSNS:
Nov 28 19:12:39 user nova-compute[75203]: No targets found.
Nov 28 19:12:39 user nova-compute[75203]: STATIC:
Nov 28 19:12:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf
Nov 28 19:12:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:12:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:12:39 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b
Nov 28 19:12:39 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:12:39 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:12:39 user nova-compute[75203]: FIRMWARE:
Nov 28 19:12:39 user nova-compute[75203]: No targets found.
Nov 28 19:12:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:12:39 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:12:39 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e96fd63-e1cf-4baa-acde-9213dd1c757a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc2bd3-bb06-4a9e-b598-48c0d60e177b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:39 user nova-compute[75203]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b (non-flash)
Nov 28 19:12:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:12:39 user nova-compute[75203]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b (non-flash)
Nov 28 19:12:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07901f6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef33c1e-cc4e-4b7c-ad11-ca58e0989e3c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f182b-e324-4e7f-aa7f-b52e33dea3ab]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d66e972-a725-4783-a53b-3858514005b3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1f3cb0-57a9-4702-a79e-5023db126b96]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56e1c51-c9d3-4715-8189-b07d460c8c0a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fca161-3d92-473f-86d9-be4ebe3b9af6]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260]
Nov 28 19:12:40 user nova-compute[75203]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b, portal: 172.16.0.220,3260] successful.
Nov 28 19:12:40 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a1e3fa3-367f-45a3-ac45-6300ed0b3f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6172a60f-2e0c-4546-ba32-e4ff721727e6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] <== disconnect_volume: return (294ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:12:40 user nova-compute[75203]: DEBUG nova.objects.instance [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'flavor' on Instance uuid 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:12:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-f2668b11-cb2b-403e-8070-e1b9b4710383 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.757s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:12:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:12:57 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:02 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:13:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:08 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:13:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:13:10 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:13:10 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=24.89102554321289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b03540f6-e447-442d-b03b-d21b121bf5a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:13:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:11 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:13:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:13:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:13:13 user nova-compute[75203]: INFO nova.compute.manager [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] instance snapshotting
Nov 28 19:13:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Beginning live snapshot process
Nov 28 19:13:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json -f qcow2 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnrt0h0ra/7d9aa941a7204ebbb8c35ef23f25d713.delta 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:14 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325f4d17ae81b876601678107eacbf8617755a0b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnrt0h0ra/7d9aa941a7204ebbb8c35ef23f25d713.delta 1073741824" returned: 0 in 0.050s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:14 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 28 19:13:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 19:13:15 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75203) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 28 19:13:15 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 28 19:13:15 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 19:13:15 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnrt0h0ra/7d9aa941a7204ebbb8c35ef23f25d713.delta /opt/stack/data/nova/instances/snapshots/tmpnrt0h0ra/7d9aa941a7204ebbb8c35ef23f25d713 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnrt0h0ra/7d9aa941a7204ebbb8c35ef23f25d713.delta /opt/stack/data/nova/instances/snapshots/tmpnrt0h0ra/7d9aa941a7204ebbb8c35ef23f25d713" returned: 0 in 0.586s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Snapshot extracted, beginning image upload
Nov 28 19:13:17 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:13:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:13:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:13:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:13:18 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Snapshot image upload complete
Nov 28 19:13:18 user nova-compute[75203]: INFO nova.compute.manager [None req-c65607b5-e0bc-4fd9-82f6-1f1d152a1908 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Took 5.18 seconds to snapshot the instance on the hypervisor.
Nov 28 19:13:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:13:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:13:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:13:18 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:13:19 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:13:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:13:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:13:21 user nova-compute[75203]: INFO nova.compute.claims [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Claim successful on node user
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:13:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.policy [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06d11170e91342349efb7e344ab6aee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e871dfa632b44069bb1ee21226f7fb3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:13:21 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Creating image(s)
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "/opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "/opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "/opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "505e2c8cab7ba22c2f9f61ce853b53e1e1344cce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "505e2c8cab7ba22c2f9f61ce853b53e1e1344cce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:22 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.part --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:22 user nova-compute[75203]: DEBUG nova.network.neutron [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Successfully created port: 5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:13:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG nova.virt.images [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] 41c1d774-b8fe-40d8-9552-501e170f8743 was qcow2, converting to raw {{(pid=75203) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG nova.privsep.utils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75203) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.part /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.converted {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Successfully updated port: 5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.part /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.converted" returned: 0 in 0.654s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.converted --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquired lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-changed-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Refreshing instance network info cache due to event network-changed-5d29a522-0b70-4703-be26-3b9a95ab8938. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] Acquiring lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "505e2c8cab7ba22c2f9f61ce853b53e1e1344cce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.183s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.neutron [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updating instance_info_cache with network_info: [{"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Releasing lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Instance network_info: |[{"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] Acquired lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Refreshing network info cache for port 5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "505e2c8cab7ba22c2f9f61ce853b53e1e1344cce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "505e2c8cab7ba22c2f9f61ce853b53e1e1344cce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce,backing_fmt=raw /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk 1073741824 {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce,backing_fmt=raw /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk 1073741824" returned: 0 in 0.051s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "505e2c8cab7ba22c2f9f61ce853b53e1e1344cce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/505e2c8cab7ba22c2f9f61ce853b53e1e1344cce --force-share --output=json" returned: 0 in 0.168s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Created local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Ensure instance console log exists: /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Start _get_guest_xml network_info=[{"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='87476cfc6e4d035168ab3f16635c6b49',container_format='bare',created_at=2023-11-28T19:13:13Z,direct_url=<?>,disk_format='qcow2',id=41c1d774-b8fe-40d8-9552-501e170f8743,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1005499159',owner='e871dfa632b44069bb1ee21226f7fb3a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T19:13:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '41c1d774-b8fe-40d8-9552-501e170f8743'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:13:24 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:13:24 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87476cfc6e4d035168ab3f16635c6b49',container_format='bare',created_at=2023-11-28T19:13:13Z,direct_url=<?>,disk_format='qcow2',id=41c1d774-b8fe-40d8-9552-501e170f8743,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1005499159',owner='e871dfa632b44069bb1ee21226f7fb3a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-28T19:13:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-815715509',display_name='tempest-TestStampPattern-server-815715509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-815715509',id=46,image_ref='41c1d774-b8fe-40d8-9552-501e170f8743',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjwXoVTXx3g1WMBTPVc3BXkuMemAGX8TzrRf6HtBtdLY/dN3tE8aN/Oy01QY+z7r8d1veP5x5qdzjPkRsvcN2rOC0Z6T1lLPx56vti7hCdJ2gyz4CzO3SnKHdFISjBeQA==',key_name='tempest-TestStampPattern-775410057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e871dfa632b44069bb1ee21226f7fb3a',ramdisk_id='',reservation_id='r-kx0d4sge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8414cd04-d905-4e89-a572-0c28aee7f515',image_min_disk='1',image_min_ram='0',image_owner_id='e871dfa632b44069bb1ee21226f7fb3a',image_owner_project_name='tempest-TestStampPattern-20479436',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-20479436-project-member',image_user_id='06d11170e91342349efb7e344ab6aee8',network_allocated='True',owner_project_name='tempest-TestStampPattern-20479436',owner_user_name='tempest-TestStampPattern-20479436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:13:22Z,user_data=None,user_id='06d11170e91342349efb7e344ab6aee8',uuid=574c2d96-fb84-48ef-9105-8e6ff1ab6814,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converting VIF {"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:9d:01,bridge_name='br-int',has_traffic_filtering=True,id=5d29a522-0b70-4703-be26-3b9a95ab8938,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d29a522-0b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.objects.instance [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'pci_devices' on Instance uuid 574c2d96-fb84-48ef-9105-8e6ff1ab6814 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:13:24 user nova-compute[75203]:   <uuid>574c2d96-fb84-48ef-9105-8e6ff1ab6814</uuid>
Nov 28 19:13:24 user nova-compute[75203]:   <name>instance-0000002e</name>
Nov 28 19:13:24 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:13:24 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:13:24 user nova-compute[75203]:   <metadata>
Nov 28 19:13:24 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:13:24 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:13:24 user nova-compute[75203]:       <nova:name>tempest-TestStampPattern-server-815715509</nova:name>
Nov 28 19:13:24 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:13:24</nova:creationTime>
Nov 28 19:13:24 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:13:24 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:13:24 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:13:24 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:13:24 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:13:24 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:13:24 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:13:24 user nova-compute[75203]:       <nova:owner>
Nov 28 19:13:24 user nova-compute[75203]:         <nova:user uuid="06d11170e91342349efb7e344ab6aee8">tempest-TestStampPattern-20479436-project-member</nova:user>
Nov 28 19:13:24 user nova-compute[75203]:         <nova:project uuid="e871dfa632b44069bb1ee21226f7fb3a">tempest-TestStampPattern-20479436</nova:project>
Nov 28 19:13:24 user nova-compute[75203]:       </nova:owner>
Nov 28 19:13:24 user nova-compute[75203]:       <nova:root type="image" uuid="41c1d774-b8fe-40d8-9552-501e170f8743"/>
Nov 28 19:13:24 user nova-compute[75203]:       <nova:ports>
Nov 28 19:13:24 user nova-compute[75203]:         <nova:port uuid="5d29a522-0b70-4703-be26-3b9a95ab8938">
Nov 28 19:13:24 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 19:13:24 user nova-compute[75203]:         </nova:port>
Nov 28 19:13:24 user nova-compute[75203]:       </nova:ports>
Nov 28 19:13:24 user nova-compute[75203]:     </nova:instance>
Nov 28 19:13:24 user nova-compute[75203]:   </metadata>
Nov 28 19:13:24 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:13:24 user nova-compute[75203]:     <system>
Nov 28 19:13:24 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:13:24 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:13:24 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:13:24 user nova-compute[75203]:       <entry name="serial">574c2d96-fb84-48ef-9105-8e6ff1ab6814</entry>
Nov 28 19:13:24 user nova-compute[75203]:       <entry name="uuid">574c2d96-fb84-48ef-9105-8e6ff1ab6814</entry>
Nov 28 19:13:24 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:13:24 user nova-compute[75203]:     </system>
Nov 28 19:13:24 user nova-compute[75203]:   </sysinfo>
Nov 28 19:13:24 user nova-compute[75203]:   <os>
Nov 28 19:13:24 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:13:24 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:13:24 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:13:24 user nova-compute[75203]:   </os>
Nov 28 19:13:24 user nova-compute[75203]:   <features>
Nov 28 19:13:24 user nova-compute[75203]:     <acpi/>
Nov 28 19:13:24 user nova-compute[75203]:     <apic/>
Nov 28 19:13:24 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:13:24 user nova-compute[75203]:   </features>
Nov 28 19:13:24 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:13:24 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:13:24 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:13:24 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:13:24 user nova-compute[75203]:   </clock>
Nov 28 19:13:24 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:13:24 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:13:24 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:13:24 user nova-compute[75203]:   </cpu>
Nov 28 19:13:24 user nova-compute[75203]:   <devices>
Nov 28 19:13:24 user nova-compute[75203]:     <disk type="file" device="disk">
Nov 28 19:13:24 user nova-compute[75203]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 28 19:13:24 user nova-compute[75203]:       <source file="/opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk"/>
Nov 28 19:13:24 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:13:24 user nova-compute[75203]:     </disk>
Nov 28 19:13:24 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:13:24 user nova-compute[75203]:       <mac address="fa:16:3e:40:9d:01"/>
Nov 28 19:13:24 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:13:24 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:13:24 user nova-compute[75203]:       <target dev="tap5d29a522-0b"/>
Nov 28 19:13:24 user nova-compute[75203]:     </interface>
Nov 28 19:13:24 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:13:24 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/console.log" append="off"/>
Nov 28 19:13:24 user nova-compute[75203]:     </serial>
Nov 28 19:13:24 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:13:24 user nova-compute[75203]:     <video>
Nov 28 19:13:24 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:13:24 user nova-compute[75203]:     </video>
Nov 28 19:13:24 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:13:24 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:13:24 user nova-compute[75203]:     </rng>
Nov 28 19:13:24 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:13:24 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:13:24 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:13:24 user nova-compute[75203]:     </memballoon>
Nov 28 19:13:24 user nova-compute[75203]:   </devices>
Nov 28 19:13:24 user nova-compute[75203]: </domain>
Nov 28 19:13:24 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-815715509',display_name='tempest-TestStampPattern-server-815715509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-815715509',id=46,image_ref='41c1d774-b8fe-40d8-9552-501e170f8743',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjwXoVTXx3g1WMBTPVc3BXkuMemAGX8TzrRf6HtBtdLY/dN3tE8aN/Oy01QY+z7r8d1veP5x5qdzjPkRsvcN2rOC0Z6T1lLPx56vti7hCdJ2gyz4CzO3SnKHdFISjBeQA==',key_name='tempest-TestStampPattern-775410057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e871dfa632b44069bb1ee21226f7fb3a',ramdisk_id='',reservation_id='r-kx0d4sge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8414cd04-d905-4e89-a572-0c28aee7f515',image_min_disk='1',image_min_ram='0',image_owner_id='e871dfa632b44069bb1ee21226f7fb3a',image_owner_project_name='tempest-TestStampPattern-20479436',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-20479436-project-member',image_user_id='06d11170e91342349efb7e344ab6aee8',network_allocated='True',owner_project_name='tempest-TestStampPattern-20479436',owner_user_name='tempest-TestStampPattern-20479436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:13:22Z,user_data=None,user_id='06d11170e91342349efb7e344ab6aee8',uuid=574c2d96-fb84-48ef-9105-8e6ff1ab6814,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converting VIF {"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:9d:01,bridge_name='br-int',has_traffic_filtering=True,id=5d29a522-0b70-4703-be26-3b9a95ab8938,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d29a522-0b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG os_vif [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:9d:01,bridge_name='br-int',has_traffic_filtering=True,id=5d29a522-0b70-4703-be26-3b9a95ab8938,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d29a522-0b') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7782a65-168e-537d-954f-510952b31ca6', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d29a522-0b, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d29a522-0b, col_values=(('qos', UUID('15b854a2-9c17-4634-85a2-07d74e19e946')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d29a522-0b, col_values=(('external_ids', {'iface-id': '5d29a522-0b70-4703-be26-3b9a95ab8938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:9d:01', 'vm-uuid': '574c2d96-fb84-48ef-9105-8e6ff1ab6814'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:24 user nova-compute[75203]: INFO os_vif [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:9d:01,bridge_name='br-int',has_traffic_filtering=True,id=5d29a522-0b70-4703-be26-3b9a95ab8938,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d29a522-0b')
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No VIF found with MAC fa:16:3e:40:9d:01, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updated VIF entry in instance network info cache for port 5d29a522-0b70-4703-be26-3b9a95ab8938. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updating instance_info_cache with network_info: [{"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:13:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-75842717-716d-41d3-b41e-2edf62fbcbba req-de637155-2f45-4d9c-8f45-ed03ef604a7c service nova] Releasing lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:13:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-b06c4b75-ef8c-49db-9822-5f548a16ea38 req-3ca150e1-8eef-4fce-a5e3-b7d632ca4608 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:13:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b06c4b75-ef8c-49db-9822-5f548a16ea38 req-3ca150e1-8eef-4fce-a5e3-b7d632ca4608 service nova] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b06c4b75-ef8c-49db-9822-5f548a16ea38 req-3ca150e1-8eef-4fce-a5e3-b7d632ca4608 service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b06c4b75-ef8c-49db-9822-5f548a16ea38 req-3ca150e1-8eef-4fce-a5e3-b7d632ca4608 service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-b06c4b75-ef8c-49db-9822-5f548a16ea38 req-3ca150e1-8eef-4fce-a5e3-b7d632ca4608 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] No waiting events found dispatching network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:13:26 user nova-compute[75203]: WARNING nova.compute.manager [req-b06c4b75-ef8c-49db-9822-5f548a16ea38 req-3ca150e1-8eef-4fce-a5e3-b7d632ca4608 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received unexpected event network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 for instance with vm_state building and task_state spawning.
Nov 28 19:13:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:13:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Instance spawned successfully.
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-c549f9f4-ed48-440e-bcb5-33aef634cf10 req-b81ca8ae-81ef-40fc-ad86-2ba9c413c5ae service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c549f9f4-ed48-440e-bcb5-33aef634cf10 req-b81ca8ae-81ef-40fc-ad86-2ba9c413c5ae service nova] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c549f9f4-ed48-440e-bcb5-33aef634cf10 req-b81ca8ae-81ef-40fc-ad86-2ba9c413c5ae service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c549f9f4-ed48-440e-bcb5-33aef634cf10 req-b81ca8ae-81ef-40fc-ad86-2ba9c413c5ae service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-c549f9f4-ed48-440e-bcb5-33aef634cf10 req-b81ca8ae-81ef-40fc-ad86-2ba9c413c5ae service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] No waiting events found dispatching network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:13:28 user nova-compute[75203]: WARNING nova.compute.manager [req-c549f9f4-ed48-440e-bcb5-33aef634cf10 req-b81ca8ae-81ef-40fc-ad86-2ba9c413c5ae service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received unexpected event network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 for instance with vm_state building and task_state spawning.
Nov 28 19:13:28 user nova-compute[75203]: INFO nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 28 19:13:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:13:28 user nova-compute[75203]: INFO nova.compute.manager [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Took 7.09 seconds to build instance.
Nov 28 19:13:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78c7cb6d-ca08-4492-b12b-70353089fa15 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.182s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:13:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:13:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:13:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing instance network info cache due to event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.network.neutron [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.network.neutron [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updated VIF entry in instance network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.network.neutron [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f16461cd-ff2a-4e9e-97a6-d93b2f70d1d6 req-29f08ce4-e5d9-4baa-aea9-cb96a0db565e service nova] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing instance network info cache due to event network-changed-b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] Acquiring lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] Acquired lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Refreshing network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:14:05 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:14:05 user nova-compute[75203]: INFO nova.compute.manager [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Detaching volume 90a51dba-f15c-4ce9-bd37-4d3608012daf
Nov 28 19:14:06 user nova-compute[75203]: INFO nova.virt.block_device [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Attempting to driver detach volume 90a51dba-f15c-4ce9-bd37-4d3608012daf from mountpoint /dev/vdb
Nov 28 19:14:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Attempting to detach device vdb from instance b03540f6-e447-442d-b03b-d21b121bf5a1 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:14:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:14:06 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:14:06 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:14:06 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:14:06 user nova-compute[75203]:   <serial>90a51dba-f15c-4ce9-bd37-4d3608012daf</serial>
Nov 28 19:14:06 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:14:06 user nova-compute[75203]: </disk>
Nov 28 19:14:06 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:14:06 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully detached device vdb from instance b03540f6-e447-442d-b03b-d21b121bf5a1 from the persistent domain config.
Nov 28 19:14:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b03540f6-e447-442d-b03b-d21b121bf5a1 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:14:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:14:06 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:14:06 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:14:06 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:14:06 user nova-compute[75203]:   <serial>90a51dba-f15c-4ce9-bd37-4d3608012daf</serial>
Nov 28 19:14:06 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:14:06 user nova-compute[75203]: </disk>
Nov 28 19:14:06 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:14:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updated VIF entry in instance network info cache for port b69adcda-86cd-4f02-8db1-f7f53efbc446. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:14:06 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [{"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:14:06 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4fdac7f-bef7-4183-b767-943ee0eb56ee req-4033e510-6516-4cdd-98cb-61e0411c0f3a service nova] Releasing lock "refresh_cache-b03540f6-e447-442d-b03b-d21b121bf5a1" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:14:06 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:14:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:14:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:14:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:14:08 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:14:08 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:10 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:14:10 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=24.744789123535156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance b03540f6-e447-442d-b03b-d21b121bf5a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:14:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:14:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:12 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:14:12 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:14:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:14:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:14:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:14:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:14:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:14:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:14:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:14:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:14:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:14:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:26 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b03540f6-e447-442d-b03b-d21b121bf5a1 is timed out.
Nov 28 19:14:26 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully detached device vdb from instance b03540f6-e447-442d-b03b-d21b121bf5a1 from the live domain config.
Nov 28 19:14:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKpmWVQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:14:26 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62f3e4f-fa14-4671-94a1-14a82d427ecb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:14:26 user nova-compute[75203]: No targets found.
Nov 28 19:14:26 user nova-compute[75203]: iSNS:
Nov 28 19:14:26 user nova-compute[75203]: No targets found.
Nov 28 19:14:26 user nova-compute[75203]: STATIC:
Nov 28 19:14:26 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf
Nov 28 19:14:26 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:14:26 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:14:26 user nova-compute[75203]: FIRMWARE:
Nov 28 19:14:26 user nova-compute[75203]: No targets found.
Nov 28 19:14:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:14:26 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:14:26 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c1d56-37e9-408e-b3ec-7d1b7932eca5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[164d8cde-de82-4a1a-836d-e6c9c64bffab]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:14:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf (non-flash)
Nov 28 19:14:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790456320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[123e34eb-f7ce-4b00-b99d-c2c74a17208d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f76065-374b-415d-bbfb-d1409826c1ea]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[be589bb4-fd0b-4830-87c8-99f3e14acff0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27171ab-f955-46d0-9abe-0f44106cdc5f]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dc00f2-1a82-4c67-a518-40a6e04db93c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2964c43-5c29-4412-9b52-0a0611eb37dd]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260]
Nov 28 19:14:26 user nova-compute[75203]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf, portal: 172.16.0.220,3260] successful.
Nov 28 19:14:26 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90a51dba-f15c-4ce9-bd37-4d3608012daf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c76cf-2242-4401-a254-6657c5ed5536]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] <== disconnect_volume: return (298ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:14:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:14:27 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'flavor' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:14:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d475a26b-7fa6-4238-83db-b9a8c8ccb519 tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.839s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:14:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:14:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:14:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:14:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:14:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:14:59 user nova-compute[75203]: INFO nova.compute.manager [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Terminating instance
Nov 28 19:14:59 user nova-compute[75203]: DEBUG nova.compute.manager [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:14:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-5cdac06e-10c9-4c77-841c-1bf4200e7ef8 req-067888f4-57d9-4230-9f74-81067cd7de80 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-unplugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5cdac06e-10c9-4c77-841c-1bf4200e7ef8 req-067888f4-57d9-4230-9f74-81067cd7de80 service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5cdac06e-10c9-4c77-841c-1bf4200e7ef8 req-067888f4-57d9-4230-9f74-81067cd7de80 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-5cdac06e-10c9-4c77-841c-1bf4200e7ef8 req-067888f4-57d9-4230-9f74-81067cd7de80 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-5cdac06e-10c9-4c77-841c-1bf4200e7ef8 req-067888f4-57d9-4230-9f74-81067cd7de80 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-unplugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.compute.manager [req-5cdac06e-10c9-4c77-841c-1bf4200e7ef8 req-067888f4-57d9-4230-9f74-81067cd7de80 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-unplugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Instance destroyed successfully.
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.objects.instance [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lazy-loading 'resources' on Instance uuid b03540f6-e447-442d-b03b-d21b121bf5a1 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:10:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2029002490',display_name='tempest-TestMinimumBasicScenario-server-2029002490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2029002490',id=44,image_ref='e6285cf6-1dca-49e4-877c-d75661bcffb8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMWSXG+SdTLLHYsGdV4qhtlWtp2ULFChzjPUtFoEa45wt2Z6StL8poXSLHrBrn/jG71JBe7QDAYz3LutjyT8chZUyDUTsbFY0bXWmvLlpKfr3AUue1zKLuViG+Gk2hw0Q==',key_name='tempest-TestMinimumBasicScenario-1157042087',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:10:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='478ac7f43b8c49abb6b7497869905748',ramdisk_id='',reservation_id='r-awe86fb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e6285cf6-1dca-49e4-877c-d75661bcffb8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-710384277',owner_user_name='tempest-TestMinimumBasicScenario-710384277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:12:21Z,user_data=None,user_id='5327ccb36afb440396c9228baa2fb85d',uuid=b03540f6-e447-442d-b03b-d21b121bf5a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converting VIF {"id": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "address": "fa:16:3e:71:71:97", "network": {"id": "be828a2a-1d4c-40c7-be22-b7a0824afdfb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1270140694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "478ac7f43b8c49abb6b7497869905748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69adcda-86", "ovs_interfaceid": "b69adcda-86cd-4f02-8db1-f7f53efbc446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:71:97,bridge_name='br-int',has_traffic_filtering=True,id=b69adcda-86cd-4f02-8db1-f7f53efbc446,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69adcda-86') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG os_vif [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:71:97,bridge_name='br-int',has_traffic_filtering=True,id=b69adcda-86cd-4f02-8db1-f7f53efbc446,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69adcda-86') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb69adcda-86, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a0928f1-1fe6-4603-95a6-33f086c37ada) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:15:00 user nova-compute[75203]: INFO os_vif [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:71:97,bridge_name='br-int',has_traffic_filtering=True,id=b69adcda-86cd-4f02-8db1-f7f53efbc446,network=Network(be828a2a-1d4c-40c7-be22-b7a0824afdfb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69adcda-86')
Nov 28 19:15:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Deleting instance files /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1_del
Nov 28 19:15:00 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Deletion of /opt/stack/data/nova/instances/b03540f6-e447-442d-b03b-d21b121bf5a1_del complete
Nov 28 19:15:00 user nova-compute[75203]: INFO nova.compute.manager [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 28 19:15:00 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:15:00 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:15:01 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:15:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-63821df5-8a01-470b-9a49-b2f0bec2f7a9 req-f24aa661-00eb-4600-8af1-ac3e31406a5f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-deleted-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:15:01 user nova-compute[75203]: INFO nova.compute.manager [req-63821df5-8a01-470b-9a49-b2f0bec2f7a9 req-f24aa661-00eb-4600-8af1-ac3e31406a5f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Neutron deleted interface b69adcda-86cd-4f02-8db1-f7f53efbc446; detaching it from the instance and deleting it from the info cache
Nov 28 19:15:01 user nova-compute[75203]: DEBUG nova.network.neutron [req-63821df5-8a01-470b-9a49-b2f0bec2f7a9 req-f24aa661-00eb-4600-8af1-ac3e31406a5f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:15:01 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Took 0.52 seconds to deallocate network for instance.
Nov 28 19:15:01 user nova-compute[75203]: DEBUG nova.compute.manager [req-63821df5-8a01-470b-9a49-b2f0bec2f7a9 req-f24aa661-00eb-4600-8af1-ac3e31406a5f service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Detach interface failed, port_id=b69adcda-86cd-4f02-8db1-f7f53efbc446, reason: Instance b03540f6-e447-442d-b03b-d21b121bf5a1 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 19:15:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:01 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:15:01 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:15:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:01 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Deleted allocations for instance b03540f6-e447-442d-b03b-d21b121bf5a1
Nov 28 19:15:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-87384da1-de32-4d4a-8e74-cdb79baebf2f tempest-TestMinimumBasicScenario-710384277 tempest-TestMinimumBasicScenario-710384277-project-member] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.745s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-f9cc86c3-2f1a-416d-b66a-5d3284949ec8 req-e2f460a0-fe65-4486-9dd9-b5680d629893 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:15:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f9cc86c3-2f1a-416d-b66a-5d3284949ec8 req-e2f460a0-fe65-4486-9dd9-b5680d629893 service nova] Acquiring lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f9cc86c3-2f1a-416d-b66a-5d3284949ec8 req-e2f460a0-fe65-4486-9dd9-b5680d629893 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f9cc86c3-2f1a-416d-b66a-5d3284949ec8 req-e2f460a0-fe65-4486-9dd9-b5680d629893 service nova] Lock "b03540f6-e447-442d-b03b-d21b121bf5a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:02 user nova-compute[75203]: DEBUG nova.compute.manager [req-f9cc86c3-2f1a-416d-b66a-5d3284949ec8 req-e2f460a0-fe65-4486-9dd9-b5680d629893 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] No waiting events found dispatching network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:15:02 user nova-compute[75203]: WARNING nova.compute.manager [req-f9cc86c3-2f1a-416d-b66a-5d3284949ec8 req-e2f460a0-fe65-4486-9dd9-b5680d629893 service nova] [instance: b03540f6-e447-442d-b03b-d21b121bf5a1] Received unexpected event network-vif-plugged-b69adcda-86cd-4f02-8db1-f7f53efbc446 for instance with vm_state deleted and task_state None.
Nov 28 19:15:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:08 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:15:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:15:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=24.771839141845703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:15:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-changed-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG nova.compute.manager [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Refreshing instance network info cache due to event network-changed-5d29a522-0b70-4703-be26-3b9a95ab8938. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] Acquiring lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] Acquired lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Refreshing network info cache for port 5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG nova.objects.instance [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'flavor' on Instance uuid 574c2d96-fb84-48ef-9105-8e6ff1ab6814 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updated VIF entry in instance network info cache for port 5d29a522-0b70-4703-be26-3b9a95ab8938. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG nova.network.neutron [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updating instance_info_cache with network_info: [{"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-65b6a303-3889-45e9-8ca5-b29aa2aaa958 req-774cade9-eb1a-4408-a3b5-156753752289 service nova] Releasing lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:13 user nova-compute[75203]: INFO nova.compute.manager [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Attaching volume 9507820b-45b7-44f0-bae4-d9ee112ffeeb to /dev/vdb
Nov 28 19:15:13 user nova-compute[75203]: DEBUG os_brick.utils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01dafb-c135-4f1e-8334-d2890ff21130]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a13617-894a-4b3d-819f-55290f09306e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dad5815-7c3a-4feb-a708-2df50c469c7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[da49fe08-5647-4a97-8a9a-3e91b8ea2ed6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:15:13 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:15:13 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee94205-81ad-4141-8747-6e97cd79c7f0]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG os_brick.utils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:15:13 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updating existing volume attachment record: 386f7af9-169c-410c-9a01-61af2dc95358 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:15:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvjdOyiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:15:20 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:15:20 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:15:20 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb85a68-4e75-45ea-a920-c94ac3c6c472]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:15:20 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc8c6b3-c2a2-4239-ae33-31af3c40bbc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb] added
Nov 28 19:15:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4601d83d-dd1d-43df-bd69-37c64bfc149a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dbbf70-ae9d-4635-a215-720fb183c2f7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvjdOyiN {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xvjdOyiN" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e494b47-e9bc-4568-b50f-fad9fc8c3fe3]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xvjdOyiN'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cba900b-1832-4956-9e65-bf98d1151f0b]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e690d7-5b6e-4dc2-909e-6c796c53a57d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:15:20 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:15:20 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:15:20 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:15:20 user nova-compute[75203]: 
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb918bb7-e25f-43d6-a7ad-eed920ae0a32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260]
Nov 28 19:15:20 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260] successful.
Nov 28 19:15:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4665b088-b353-48a5-b902-fda2611546d6]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84f8ef-6d7d-44cd-9300-e2cde1035c5a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb (non-flash)
Nov 28 19:15:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb (non-flash)
Nov 28 19:15:20 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[71509922-4060-47b2-81f7-73743b1ecfb6]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:15:20 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvjdOyiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26338626564383535', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338626564383535', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG nova.objects.instance [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'flavor' on Instance uuid 574c2d96-fb84-48ef-9105-8e6ff1ab6814 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:15:21 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] attach device xml: <disk type="block" device="disk">
Nov 28 19:15:21 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:15:21 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:15:21 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:15:21 user nova-compute[75203]:   <serial>9507820b-45b7-44f0-bae4-d9ee112ffeeb</serial>
Nov 28 19:15:21 user nova-compute[75203]: </disk>
Nov 28 19:15:21 user nova-compute[75203]:  {{(pid=75203) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 28 19:15:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:15:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:15:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] No VIF found with MAC fa:16:3e:40:9d:01, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:15:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-76508b8c-26e5-433b-bcd8-21806f2155ca tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.650s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:15:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:15:24 user nova-compute[75203]: INFO nova.compute.manager [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Detaching volume 9507820b-45b7-44f0-bae4-d9ee112ffeeb
Nov 28 19:15:24 user nova-compute[75203]: INFO nova.virt.block_device [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Attempting to driver detach volume 9507820b-45b7-44f0-bae4-d9ee112ffeeb from mountpoint /dev/vdb
Nov 28 19:15:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Attempting to detach device vdb from instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 from the persistent domain config. {{(pid=75203) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 28 19:15:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:15:24 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:15:24 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:15:24 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:15:24 user nova-compute[75203]:   <serial>9507820b-45b7-44f0-bae4-d9ee112ffeeb</serial>
Nov 28 19:15:24 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:15:24 user nova-compute[75203]: </disk>
Nov 28 19:15:24 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:15:24 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully detached device vdb from instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 from the persistent domain config.
Nov 28 19:15:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 from the live domain config. {{(pid=75203) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 28 19:15:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.guest [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] detach device xml: <disk type="block" device="disk">
Nov 28 19:15:24 user nova-compute[75203]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:15:24 user nova-compute[75203]:   <source dev="/dev/sdb"/>
Nov 28 19:15:24 user nova-compute[75203]:   <target dev="vdb" bus="virtio"/>
Nov 28 19:15:24 user nova-compute[75203]:   <serial>9507820b-45b7-44f0-bae4-d9ee112ffeeb</serial>
Nov 28 19:15:24 user nova-compute[75203]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 28 19:15:24 user nova-compute[75203]: </disk>
Nov 28 19:15:24 user nova-compute[75203]:  {{(pid=75203) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 28 19:15:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 {{(pid=75203) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 28 19:15:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:15:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:44 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 is timed out.
Nov 28 19:15:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully detached device vdb from instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 from the live domain config.
Nov 28 19:15:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xvjdOyiN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:15:44 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:15:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[11235450-59e2-4061-b532-d0b3cd60c619]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:15:44 user nova-compute[75203]: No targets found.
Nov 28 19:15:44 user nova-compute[75203]: iSNS:
Nov 28 19:15:44 user nova-compute[75203]: No targets found.
Nov 28 19:15:44 user nova-compute[75203]: STATIC:
Nov 28 19:15:44 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb
Nov 28 19:15:44 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:15:44 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:15:44 user nova-compute[75203]: FIRMWARE:
Nov 28 19:15:44 user nova-compute[75203]: No targets found.
Nov 28 19:15:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:15:44 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:15:44 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc47ff1-e377-4dc6-a8a5-6c20937dade6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c607449-2371-4f0c-a926-7cfa8155b6fd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb (non-flash)
Nov 28 19:15:45 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb (non-flash)
Nov 28 19:15:45 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07901f4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[44598c18-3404-407a-a587-bc333e2eb3eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[af958a48-ab82-4efa-a345-c12853455e57]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3437a500-e4bd-414d-b614-ed287311222d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f514eb2-6253-4841-85b3-98d89043e9de]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e830d57e-c1d0-482f-8c87-6b25775320fb]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff9b95-461f-4378-9187-682c18b841ef]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260]
Nov 28 19:15:45 user nova-compute[75203]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb, portal: 172.16.0.220,3260] successful.
Nov 28 19:15:45 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9507820b-45b7-44f0-bae4-d9ee112ffeeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d4f84-b24d-4cd5-b864-327770efa721]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] <== disconnect_volume: return (295ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:15:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:46 user nova-compute[75203]: DEBUG nova.objects.instance [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'flavor' on Instance uuid 574c2d96-fb84-48ef-9105-8e6ff1ab6814 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:15:46 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-71b1b5cf-0000-43ec-9127-d0923405b6d0 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:15:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:15:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:01 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:16:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:16:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:16:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:16:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:16:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:16:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:16:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:16:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:16:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:16:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:16:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:16:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=24.810142517089844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:16:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:16:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:16:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-changed-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Refreshing instance network info cache due to event network-changed-5d29a522-0b70-4703-be26-3b9a95ab8938. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] Acquiring lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] Acquired lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.network.neutron [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Refreshing network info cache for port 5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:16:15 user nova-compute[75203]: INFO nova.compute.manager [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Terminating instance
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-17fd7521-211d-42ca-b0cc-cfb5c7cc258b req-9b3dc24b-e63e-4b5e-a2fa-116da2d6d367 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-vif-unplugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17fd7521-211d-42ca-b0cc-cfb5c7cc258b req-9b3dc24b-e63e-4b5e-a2fa-116da2d6d367 service nova] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17fd7521-211d-42ca-b0cc-cfb5c7cc258b req-9b3dc24b-e63e-4b5e-a2fa-116da2d6d367 service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-17fd7521-211d-42ca-b0cc-cfb5c7cc258b req-9b3dc24b-e63e-4b5e-a2fa-116da2d6d367 service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-17fd7521-211d-42ca-b0cc-cfb5c7cc258b req-9b3dc24b-e63e-4b5e-a2fa-116da2d6d367 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] No waiting events found dispatching network-vif-unplugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-17fd7521-211d-42ca-b0cc-cfb5c7cc258b req-9b3dc24b-e63e-4b5e-a2fa-116da2d6d367 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-vif-unplugged-5d29a522-0b70-4703-be26-3b9a95ab8938 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.network.neutron [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updated VIF entry in instance network info cache for port 5d29a522-0b70-4703-be26-3b9a95ab8938. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG nova.network.neutron [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updating instance_info_cache with network_info: [{"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:16:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-79da1aa8-fd78-4986-a50f-b5191d2628a9 req-5bbe12c5-3f96-4c4f-8bde-bdec766c4a4e service nova] Releasing lock "refresh_cache-574c2d96-fb84-48ef-9105-8e6ff1ab6814" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:16:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Instance destroyed successfully.
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.objects.instance [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'resources' on Instance uuid 574c2d96-fb84-48ef-9105-8e6ff1ab6814 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-815715509',display_name='tempest-TestStampPattern-server-815715509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-815715509',id=46,image_ref='41c1d774-b8fe-40d8-9552-501e170f8743',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjwXoVTXx3g1WMBTPVc3BXkuMemAGX8TzrRf6HtBtdLY/dN3tE8aN/Oy01QY+z7r8d1veP5x5qdzjPkRsvcN2rOC0Z6T1lLPx56vti7hCdJ2gyz4CzO3SnKHdFISjBeQA==',key_name='tempest-TestStampPattern-775410057',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:13:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e871dfa632b44069bb1ee21226f7fb3a',ramdisk_id='',reservation_id='r-kx0d4sge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8414cd04-d905-4e89-a572-0c28aee7f515',image_min_disk='1',image_min_ram='0',image_owner_id='e871dfa632b44069bb1ee21226f7fb3a',image_owner_project_name='tempest-TestStampPattern-20479436',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-20479436-project-member',image_user_id='06d11170e91342349efb7e344ab6aee8',owner_project_name='tempest-TestStampPattern-20479436',owner_user_name='tempest-TestStampPattern-20479436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:13:28Z,user_data=None,user_id='06d11170e91342349efb7e344ab6aee8',uuid=574c2d96-fb84-48ef-9105-8e6ff1ab6814,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converting VIF {"id": "5d29a522-0b70-4703-be26-3b9a95ab8938", "address": "fa:16:3e:40:9d:01", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d29a522-0b", "ovs_interfaceid": "5d29a522-0b70-4703-be26-3b9a95ab8938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:9d:01,bridge_name='br-int',has_traffic_filtering=True,id=5d29a522-0b70-4703-be26-3b9a95ab8938,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d29a522-0b') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG os_vif [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:9d:01,bridge_name='br-int',has_traffic_filtering=True,id=5d29a522-0b70-4703-be26-3b9a95ab8938,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d29a522-0b') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d29a522-0b, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15b854a2-9c17-4634-85a2-07d74e19e946) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:16:16 user nova-compute[75203]: INFO os_vif [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:9d:01,bridge_name='br-int',has_traffic_filtering=True,id=5d29a522-0b70-4703-be26-3b9a95ab8938,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d29a522-0b')
Nov 28 19:16:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Deleting instance files /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814_del
Nov 28 19:16:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Deletion of /opt/stack/data/nova/instances/574c2d96-fb84-48ef-9105-8e6ff1ab6814_del complete
Nov 28 19:16:16 user nova-compute[75203]: INFO nova.compute.manager [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 28 19:16:16 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:16:16 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Took 0.40 seconds to deallocate network for instance.
Nov 28 19:16:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:16:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:16:16 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Deleted allocations for instance 574c2d96-fb84-48ef-9105-8e6ff1ab6814
Nov 28 19:16:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-78866b26-4caf-4e95-8244-6883627eabb7 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.564s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:16:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-b1cbb63b-7ad7-40c7-9d9c-0f7dc1f9a4e5 req-3dc5c9b2-0af8-4ee3-8e83-f0d47a9f7690 service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-vif-deleted-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:16:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-b8ff79b3-621b-4855-8516-4fa3aef92963 req-a1b1908c-8eb5-42ff-999b-d0a99673afbd service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received event network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:16:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b8ff79b3-621b-4855-8516-4fa3aef92963 req-a1b1908c-8eb5-42ff-999b-d0a99673afbd service nova] Acquiring lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:16:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b8ff79b3-621b-4855-8516-4fa3aef92963 req-a1b1908c-8eb5-42ff-999b-d0a99673afbd service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:16:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b8ff79b3-621b-4855-8516-4fa3aef92963 req-a1b1908c-8eb5-42ff-999b-d0a99673afbd service nova] Lock "574c2d96-fb84-48ef-9105-8e6ff1ab6814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:16:17 user nova-compute[75203]: DEBUG nova.compute.manager [req-b8ff79b3-621b-4855-8516-4fa3aef92963 req-a1b1908c-8eb5-42ff-999b-d0a99673afbd service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] No waiting events found dispatching network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:16:17 user nova-compute[75203]: WARNING nova.compute.manager [req-b8ff79b3-621b-4855-8516-4fa3aef92963 req-a1b1908c-8eb5-42ff-999b-d0a99673afbd service nova] [instance: 574c2d96-fb84-48ef-9105-8e6ff1ab6814] Received unexpected event network-vif-plugged-5d29a522-0b70-4703-be26-3b9a95ab8938 for instance with vm_state deleted and task_state None.
Nov 28 19:16:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:16:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:16:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:16:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:16:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:16:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:16:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:16:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:16:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:16:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:16:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:16:50 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:16:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:16:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:11 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:17:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:17:11 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:17:11 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:17:11 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:17:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:17:12 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:17:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=24.900474548339844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 8414cd04-d905-4e89-a572-0c28aee7f515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:17:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:17:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-changed-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Refreshing instance network info cache due to event network-changed-1cad9850-3744-41be-869c-16bb5a0dc31d. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] Acquiring lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] Acquired lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.network.neutron [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Refreshing network info cache for port 1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:17:14 user nova-compute[75203]: INFO nova.compute.manager [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Terminating instance
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-b28a16e9-849c-40bf-a962-bbdfdfccb0b2 req-0b506ff1-accb-4dc5-b0c3-706d8f823f9f service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-vif-unplugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b28a16e9-849c-40bf-a962-bbdfdfccb0b2 req-0b506ff1-accb-4dc5-b0c3-706d8f823f9f service nova] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b28a16e9-849c-40bf-a962-bbdfdfccb0b2 req-0b506ff1-accb-4dc5-b0c3-706d8f823f9f service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b28a16e9-849c-40bf-a962-bbdfdfccb0b2 req-0b506ff1-accb-4dc5-b0c3-706d8f823f9f service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-b28a16e9-849c-40bf-a962-bbdfdfccb0b2 req-0b506ff1-accb-4dc5-b0c3-706d8f823f9f service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] No waiting events found dispatching network-vif-unplugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-b28a16e9-849c-40bf-a962-bbdfdfccb0b2 req-0b506ff1-accb-4dc5-b0c3-706d8f823f9f service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-vif-unplugged-1cad9850-3744-41be-869c-16bb5a0dc31d for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.network.neutron [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updated VIF entry in instance network info cache for port 1cad9850-3744-41be-869c-16bb5a0dc31d. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.network.neutron [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [{"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fc8e8733-2b2d-4a88-a9f8-26e28117df06 req-2e2f392a-f512-46f8-9f56-aa5ca3858089 service nova] Releasing lock "refresh_cache-8414cd04-d905-4e89-a572-0c28aee7f515" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:14 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Instance destroyed successfully.
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.objects.instance [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lazy-loading 'resources' on Instance uuid 8414cd04-d905-4e89-a572-0c28aee7f515 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:10:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1597976167',display_name='tempest-TestStampPattern-server-1597976167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1597976167',id=45,image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjwXoVTXx3g1WMBTPVc3BXkuMemAGX8TzrRf6HtBtdLY/dN3tE8aN/Oy01QY+z7r8d1veP5x5qdzjPkRsvcN2rOC0Z6T1lLPx56vti7hCdJ2gyz4CzO3SnKHdFISjBeQA==',key_name='tempest-TestStampPattern-775410057',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:10:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e871dfa632b44069bb1ee21226f7fb3a',ramdisk_id='',reservation_id='r-lp4w0xe8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6c841bc3-8129-43e8-9397-445eaf245bad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-20479436',owner_user_name='tempest-TestStampPattern-20479436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:13:19Z,user_data=None,user_id='06d11170e91342349efb7e344ab6aee8',uuid=8414cd04-d905-4e89-a572-0c28aee7f515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converting VIF {"id": "1cad9850-3744-41be-869c-16bb5a0dc31d", "address": "fa:16:3e:f0:f1:8a", "network": {"id": "ed049851-127d-4fad-9422-4c545189e7b8", "bridge": "br-int", "label": "tempest-TestStampPattern-1631692737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e871dfa632b44069bb1ee21226f7fb3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cad9850-37", "ovs_interfaceid": "1cad9850-3744-41be-869c-16bb5a0dc31d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f1:8a,bridge_name='br-int',has_traffic_filtering=True,id=1cad9850-3744-41be-869c-16bb5a0dc31d,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cad9850-37') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG os_vif [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f1:8a,bridge_name='br-int',has_traffic_filtering=True,id=1cad9850-3744-41be-869c-16bb5a0dc31d,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cad9850-37') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cad9850-37, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ede9419-0a4d-4465-ac13-627b7d272ef2) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:14 user nova-compute[75203]: INFO os_vif [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:f1:8a,bridge_name='br-int',has_traffic_filtering=True,id=1cad9850-3744-41be-869c-16bb5a0dc31d,network=Network(ed049851-127d-4fad-9422-4c545189e7b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cad9850-37')
Nov 28 19:17:14 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Deleting instance files /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515_del
Nov 28 19:17:14 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Deletion of /opt/stack/data/nova/instances/8414cd04-d905-4e89-a572-0c28aee7f515_del complete
Nov 28 19:17:15 user nova-compute[75203]: INFO nova.compute.manager [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 28 19:17:15 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:17:15 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:17:15 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:17:15 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:17:15 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Took 0.49 seconds to deallocate network for instance.
Nov 28 19:17:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:17:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:17:15 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:17:15 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:17:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:17:15 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Deleted allocations for instance 8414cd04-d905-4e89-a572-0c28aee7f515
Nov 28 19:17:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-debe4c97-682d-45e6-bdec-b320877e0fe8 tempest-TestStampPattern-20479436 tempest-TestStampPattern-20479436-project-member] Lock "8414cd04-d905-4e89-a572-0c28aee7f515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.689s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:17:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-f71a8447-5b83-4625-86cc-10d8d749fc68 req-68b69edb-2fa0-4088-81ed-db56900eca3d service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:17:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f71a8447-5b83-4625-86cc-10d8d749fc68 req-68b69edb-2fa0-4088-81ed-db56900eca3d service nova] Acquiring lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:17:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f71a8447-5b83-4625-86cc-10d8d749fc68 req-68b69edb-2fa0-4088-81ed-db56900eca3d service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:17:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f71a8447-5b83-4625-86cc-10d8d749fc68 req-68b69edb-2fa0-4088-81ed-db56900eca3d service nova] Lock "8414cd04-d905-4e89-a572-0c28aee7f515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:17:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-f71a8447-5b83-4625-86cc-10d8d749fc68 req-68b69edb-2fa0-4088-81ed-db56900eca3d service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] No waiting events found dispatching network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:17:16 user nova-compute[75203]: WARNING nova.compute.manager [req-f71a8447-5b83-4625-86cc-10d8d749fc68 req-68b69edb-2fa0-4088-81ed-db56900eca3d service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received unexpected event network-vif-plugged-1cad9850-3744-41be-869c-16bb5a0dc31d for instance with vm_state deleted and task_state None.
Nov 28 19:17:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-f71a8447-5b83-4625-86cc-10d8d749fc68 req-68b69edb-2fa0-4088-81ed-db56900eca3d service nova] [instance: 8414cd04-d905-4e89-a572-0c28aee7f515] Received event network-vif-deleted-1cad9850-3744-41be-869c-16bb5a0dc31d {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:17:16 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:17:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:17:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:17:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:23 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:17:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:17:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:17:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:17:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:17:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:17:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:17:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:17:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:17:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:18:13 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:18:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:18:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:18:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9169MB free_disk=24.92721176147461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:18:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:16 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:23 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:18:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:18:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:18:23 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:18:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "d7283351-73bd-485c-b8d1-ba0269c1f20c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:18:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:18:36 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:18:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:18:36 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:18:36 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:18:36 user nova-compute[75203]: INFO nova.compute.claims [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Claim successful on node user
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:18:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:18:37 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:18:37 user nova-compute[75203]: INFO nova.virt.block_device [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Booting with volume snapshot c6e8a648-8982-4fd7-9e70-3cbe909685e4 at /dev/vda
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.policy [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c05ab9db4044e19fef91d0cab2ba03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31eb98a16d749d59528a72449f26c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:18:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Successfully created port: 5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Successfully updated port: 5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquired lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received event network-changed-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.compute.manager [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Refreshing instance network info cache due to event network-changed-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] Acquiring lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updating instance_info_cache with network_info: [{"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Releasing lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Instance network_info: |[{"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] Acquired lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:18:38 user nova-compute[75203]: DEBUG nova.network.neutron [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Refreshing network info cache for port 5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:18:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updated VIF entry in instance network info cache for port 5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:18:39 user nova-compute[75203]: DEBUG nova.network.neutron [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updating instance_info_cache with network_info: [{"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:18:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3ee94c0c-41d9-4974-a419-252594773b90 req-1a44beb6-c440-44b9-bca3-910f39d6d0c8 service nova] Releasing lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:18:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG os_brick.utils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d63adc9-5160-488c-89db-82d468de7036]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[51404722-eca7-47fd-b371-5e326cfdda80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab1cf0a-35bc-44c3-a4c7-45d6ec209396]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7a1211-ef22-4b11-97c1-861f188079a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:42 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:18:43 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:18:43 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1c797d-0234-45fd-be18-3c72659f1bf2]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG os_brick.utils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:18:43 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updating existing volume attachment record: 9f2432de-9eb6-4841-af27-e48f7f513120 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:18:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:18:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Creating image(s)
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Ensure instance console log exists: /opt/stack/data/nova/instances/d7283351-73bd-485c-b8d1-ba0269c1f20c/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Start _get_guest_xml network_info=[{"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiZHAMkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7283351-73bd-485c-b8d1-ba0269c1f20c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cedcecd3-3d94-4e20-97ba-5f779239a18a', 'serial': 'cedcecd3-3d94-4e20-97ba-5f779239a18a'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '9f2432de-9eb6-4841-af27-e48f7f513120', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:18:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:18:49 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiZHAMkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:18:49 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:18:49 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:18:49 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71af859-4c82-4f7e-b309-6916ba67ebbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:18:49 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687b34a-0c95-4081-9e3a-49401e6c6377]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a] added
Nov 28 19:18:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75011cf-23a4-495d-b81b-9a3acf3c2b2a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3bd46c-4c4e-45f0-aebf-ad444a61b559]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiZHAMkp {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiZHAMkp" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d46be49-7154-43a3-8556-718a987a7649]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YiZHAMkp'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21422c-adf7-48c3-ae3d-615a29f8629d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fd1e0d-3e9e-4a34-aef3-40526fa4c65a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:18:49 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:18:49 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:18:49 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:18:49 user nova-compute[75203]: 
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1849d412-c0aa-47b0-9cff-310ad1ba8646]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260]
Nov 28 19:18:49 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260] successful.
Nov 28 19:18:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[deddbbbd-5d98-4b5d-b685-42183f5b0144]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[706778b3-d626-41ae-a9e6-39ab14524511]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a (non-flash)
Nov 28 19:18:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a (non-flash)
Nov 28 19:18:49 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:18:49 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:18:50 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:18:50 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f235a57-3a44-4afc-b2b3-571489e8da39]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:18:50 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:18:50 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiZHAMkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23066323261653733', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066323261653733', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-11325873',display_name='tempest-TestVolumeBootPattern-server-11325873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-11325873',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-77ojfkgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:18:37Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=d7283351-73bd-485c-b8d1-ba0269c1f20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:c2,bridge_name='br-int',has_traffic_filtering=True,id=5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5874dcbc-2a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.objects.instance [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'pci_devices' on Instance uuid d7283351-73bd-485c-b8d1-ba0269c1f20c {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:18:51 user nova-compute[75203]:   <uuid>d7283351-73bd-485c-b8d1-ba0269c1f20c</uuid>
Nov 28 19:18:51 user nova-compute[75203]:   <name>instance-0000002f</name>
Nov 28 19:18:51 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:18:51 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:18:51 user nova-compute[75203]:   <metadata>
Nov 28 19:18:51 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:18:51 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:18:51 user nova-compute[75203]:       <nova:name>tempest-TestVolumeBootPattern-server-11325873</nova:name>
Nov 28 19:18:51 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:18:49</nova:creationTime>
Nov 28 19:18:51 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:18:51 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:18:51 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:18:51 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:18:51 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:18:51 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:18:51 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:18:51 user nova-compute[75203]:       <nova:owner>
Nov 28 19:18:51 user nova-compute[75203]:         <nova:user uuid="a2c05ab9db4044e19fef91d0cab2ba03">tempest-TestVolumeBootPattern-1643995956-project-member</nova:user>
Nov 28 19:18:51 user nova-compute[75203]:         <nova:project uuid="e31eb98a16d749d59528a72449f26c46">tempest-TestVolumeBootPattern-1643995956</nova:project>
Nov 28 19:18:51 user nova-compute[75203]:       </nova:owner>
Nov 28 19:18:51 user nova-compute[75203]:       <nova:ports>
Nov 28 19:18:51 user nova-compute[75203]:         <nova:port uuid="5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed">
Nov 28 19:18:51 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 28 19:18:51 user nova-compute[75203]:         </nova:port>
Nov 28 19:18:51 user nova-compute[75203]:       </nova:ports>
Nov 28 19:18:51 user nova-compute[75203]:     </nova:instance>
Nov 28 19:18:51 user nova-compute[75203]:   </metadata>
Nov 28 19:18:51 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:18:51 user nova-compute[75203]:     <system>
Nov 28 19:18:51 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:18:51 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:18:51 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:18:51 user nova-compute[75203]:       <entry name="serial">d7283351-73bd-485c-b8d1-ba0269c1f20c</entry>
Nov 28 19:18:51 user nova-compute[75203]:       <entry name="uuid">d7283351-73bd-485c-b8d1-ba0269c1f20c</entry>
Nov 28 19:18:51 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:18:51 user nova-compute[75203]:     </system>
Nov 28 19:18:51 user nova-compute[75203]:   </sysinfo>
Nov 28 19:18:51 user nova-compute[75203]:   <os>
Nov 28 19:18:51 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:18:51 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:18:51 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:18:51 user nova-compute[75203]:   </os>
Nov 28 19:18:51 user nova-compute[75203]:   <features>
Nov 28 19:18:51 user nova-compute[75203]:     <acpi/>
Nov 28 19:18:51 user nova-compute[75203]:     <apic/>
Nov 28 19:18:51 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:18:51 user nova-compute[75203]:   </features>
Nov 28 19:18:51 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:18:51 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:18:51 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:18:51 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:18:51 user nova-compute[75203]:   </clock>
Nov 28 19:18:51 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:18:51 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:18:51 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:18:51 user nova-compute[75203]:   </cpu>
Nov 28 19:18:51 user nova-compute[75203]:   <devices>
Nov 28 19:18:51 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:18:51 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:18:51 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 19:18:51 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:18:51 user nova-compute[75203]:       <serial>cedcecd3-3d94-4e20-97ba-5f779239a18a</serial>
Nov 28 19:18:51 user nova-compute[75203]:     </disk>
Nov 28 19:18:51 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:18:51 user nova-compute[75203]:       <mac address="fa:16:3e:db:78:c2"/>
Nov 28 19:18:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:18:51 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:18:51 user nova-compute[75203]:       <target dev="tap5874dcbc-2a"/>
Nov 28 19:18:51 user nova-compute[75203]:     </interface>
Nov 28 19:18:51 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:18:51 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/d7283351-73bd-485c-b8d1-ba0269c1f20c/console.log" append="off"/>
Nov 28 19:18:51 user nova-compute[75203]:     </serial>
Nov 28 19:18:51 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:18:51 user nova-compute[75203]:     <video>
Nov 28 19:18:51 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:18:51 user nova-compute[75203]:     </video>
Nov 28 19:18:51 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:18:51 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:18:51 user nova-compute[75203]:     </rng>
Nov 28 19:18:51 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:18:51 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:18:51 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:18:51 user nova-compute[75203]:     </memballoon>
Nov 28 19:18:51 user nova-compute[75203]:   </devices>
Nov 28 19:18:51 user nova-compute[75203]: </domain>
Nov 28 19:18:51 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-11325873',display_name='tempest-TestVolumeBootPattern-server-11325873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-11325873',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-77ojfkgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:18:37Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=d7283351-73bd-485c-b8d1-ba0269c1f20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:c2,bridge_name='br-int',has_traffic_filtering=True,id=5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5874dcbc-2a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG os_vif [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:c2,bridge_name='br-int',has_traffic_filtering=True,id=5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5874dcbc-2a') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb3a635b-a9a0-5db8-9e9e-ab47a3483af7', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5874dcbc-2a, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5874dcbc-2a, col_values=(('qos', UUID('ddee9d4e-f85e-460a-9396-5add5f83ebb4')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5874dcbc-2a, col_values=(('external_ids', {'iface-id': '5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:78:c2', 'vm-uuid': 'd7283351-73bd-485c-b8d1-ba0269c1f20c'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:51 user nova-compute[75203]: INFO os_vif [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:c2,bridge_name='br-int',has_traffic_filtering=True,id=5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5874dcbc-2a')
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:18:51 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No VIF found with MAC fa:16:3e:db:78:c2, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-a313f966-db68-4175-8646-30acc8688145 req-46dc967d-205f-47d1-85a7-a5cc4dd72f5c service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received event network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a313f966-db68-4175-8646-30acc8688145 req-46dc967d-205f-47d1-85a7-a5cc4dd72f5c service nova] Acquiring lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a313f966-db68-4175-8646-30acc8688145 req-46dc967d-205f-47d1-85a7-a5cc4dd72f5c service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-a313f966-db68-4175-8646-30acc8688145 req-46dc967d-205f-47d1-85a7-a5cc4dd72f5c service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:18:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-a313f966-db68-4175-8646-30acc8688145 req-46dc967d-205f-47d1-85a7-a5cc4dd72f5c service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] No waiting events found dispatching network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:18:52 user nova-compute[75203]: WARNING nova.compute.manager [req-a313f966-db68-4175-8646-30acc8688145 req-46dc967d-205f-47d1-85a7-a5cc4dd72f5c service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received unexpected event network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed for instance with vm_state building and task_state spawning.
Nov 28 19:18:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:18:54 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Instance spawned successfully.
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:18:54 user nova-compute[75203]: INFO nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-0208a182-3900-446b-ba25-c68c70354b56 req-8048ff02-a860-4992-ac03-80b7adfa033e service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received event network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0208a182-3900-446b-ba25-c68c70354b56 req-8048ff02-a860-4992-ac03-80b7adfa033e service nova] Acquiring lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0208a182-3900-446b-ba25-c68c70354b56 req-8048ff02-a860-4992-ac03-80b7adfa033e service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0208a182-3900-446b-ba25-c68c70354b56 req-8048ff02-a860-4992-ac03-80b7adfa033e service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:18:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-0208a182-3900-446b-ba25-c68c70354b56 req-8048ff02-a860-4992-ac03-80b7adfa033e service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] No waiting events found dispatching network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:18:54 user nova-compute[75203]: WARNING nova.compute.manager [req-0208a182-3900-446b-ba25-c68c70354b56 req-8048ff02-a860-4992-ac03-80b7adfa033e service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received unexpected event network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed for instance with vm_state building and task_state spawning.
Nov 28 19:18:54 user nova-compute[75203]: INFO nova.compute.manager [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Took 17.82 seconds to build instance.
Nov 28 19:18:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-d96f425e-bc86-4ce7-a0df-3063cb40990a tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.964s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:18:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:18:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:19:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:19:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:19:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:19:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=24.924358367919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance d7283351-73bd-485c-b8d1-ba0269c1f20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:19:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:19:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:19:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:19:23 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid d7283351-73bd-485c-b8d1-ba0269c1f20c {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:19:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:24 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updating instance_info_cache with network_info: [{"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:19:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:19:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:19:25 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:19:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:19:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:19:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:19:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:19:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:19:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:19:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:20:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:20:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:20:13 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:20:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:20:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:20:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:20:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=24.92371368408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance d7283351-73bd-485c-b8d1-ba0269c1f20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:20:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:20:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:20:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:20:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:20:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:20:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:20:25 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:20:25 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid d7283351-73bd-485c-b8d1-ba0269c1f20c {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:20:25 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updating instance_info_cache with network_info: [{"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:20:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-d7283351-73bd-485c-b8d1-ba0269c1f20c" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:20:25 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:20:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:20:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "d7283351-73bd-485c-b8d1-ba0269c1f20c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:20:27 user nova-compute[75203]: INFO nova.compute.manager [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Terminating instance
Nov 28 19:20:27 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG nova.compute.manager [req-984e88c1-89d6-48d7-89a6-e71b52c9fbc0 req-5dcfc95b-4794-4064-b337-68cf30193063 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received event network-vif-unplugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-984e88c1-89d6-48d7-89a6-e71b52c9fbc0 req-5dcfc95b-4794-4064-b337-68cf30193063 service nova] Acquiring lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-984e88c1-89d6-48d7-89a6-e71b52c9fbc0 req-5dcfc95b-4794-4064-b337-68cf30193063 service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-984e88c1-89d6-48d7-89a6-e71b52c9fbc0 req-5dcfc95b-4794-4064-b337-68cf30193063 service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG nova.compute.manager [req-984e88c1-89d6-48d7-89a6-e71b52c9fbc0 req-5dcfc95b-4794-4064-b337-68cf30193063 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] No waiting events found dispatching network-vif-unplugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG nova.compute.manager [req-984e88c1-89d6-48d7-89a6-e71b52c9fbc0 req-5dcfc95b-4794-4064-b337-68cf30193063 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received event network-vif-unplugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:20:27 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Instance destroyed successfully.
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.objects.instance [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'resources' on Instance uuid d7283351-73bd-485c-b8d1-ba0269c1f20c {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-11325873',display_name='tempest-TestVolumeBootPattern-server-11325873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-11325873',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:18:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-77ojfkgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:18:55Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=d7283351-73bd-485c-b8d1-ba0269c1f20c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "address": "fa:16:3e:db:78:c2", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5874dcbc-2a", "ovs_interfaceid": "5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:78:c2,bridge_name='br-int',has_traffic_filtering=True,id=5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5874dcbc-2a') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_vif [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:78:c2,bridge_name='br-int',has_traffic_filtering=True,id=5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5874dcbc-2a') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5874dcbc-2a, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddee9d4e-f85e-460a-9396-5add5f83ebb4) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:20:28 user nova-compute[75203]: INFO os_vif [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:78:c2,bridge_name='br-int',has_traffic_filtering=True,id=5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5874dcbc-2a')
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiZHAMkp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:20:28 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4626c1a8-5d50-4e28-937f-b0a5a0d3c569]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:20:28 user nova-compute[75203]: No targets found.
Nov 28 19:20:28 user nova-compute[75203]: iSNS:
Nov 28 19:20:28 user nova-compute[75203]: No targets found.
Nov 28 19:20:28 user nova-compute[75203]: STATIC:
Nov 28 19:20:28 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a
Nov 28 19:20:28 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:20:28 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:20:28 user nova-compute[75203]: FIRMWARE:
Nov 28 19:20:28 user nova-compute[75203]: No targets found.
Nov 28 19:20:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:20:28 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:20:28 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f05a5-dcfb-4bec-a9a8-3314dc79b148]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26f1d53-95c4-436d-8cf5-9a7b5a2de301]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a (non-flash)
Nov 28 19:20:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a (non-flash)
Nov 28 19:20:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a825e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a06105-75eb-4473-9241-66eb878ddc7e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e1d06-cfde-461e-a1e2-913968266919]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[25292bd5-6f06-474e-b8af-b37c6155e380]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3184976-b6b5-4f16-908f-4260e41bf0d1]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23066323261653733', '/dev/disk/by-id/scsi-1SCST_BIO839a05d-0f22ae733f9affd3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_839a05d') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cbe752-a77d-42c2-b502-34bda2ca8f2a]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6735de23-5dc0-4ddb-bce5-19e061234883]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f57b4-fbdd-499c-8899-96e426db46fb]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260]
Nov 28 19:20:28 user nova-compute[75203]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a, portal: 172.16.0.220,3260] successful.
Nov 28 19:20:28 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cedcecd3-3d94-4e20-97ba-5f779239a18a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[32175fea-dadd-4dd2-91d1-13a3b5398447]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== disconnect_volume: return (310ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:20:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Deleting instance files /opt/stack/data/nova/instances/d7283351-73bd-485c-b8d1-ba0269c1f20c_del
Nov 28 19:20:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Deletion of /opt/stack/data/nova/instances/d7283351-73bd-485c-b8d1-ba0269c1f20c_del complete
Nov 28 19:20:28 user nova-compute[75203]: INFO nova.compute.manager [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 28 19:20:28 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:20:28 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:20:28 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Took 0.50 seconds to deallocate network for instance.
Nov 28 19:20:29 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4a9a530-d19a-49bc-a8a6-3dfb6468473c req-767f1a62-0a78-4e41-a0a6-1c890c6ce073 service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received event network-vif-deleted-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG nova.compute.manager [req-9fa3abea-d6c9-4112-bc4b-bc098897c712 req-acb42db6-a77b-45e4-a926-f9ed5188a0af service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received event network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9fa3abea-d6c9-4112-bc4b-bc098897c712 req-acb42db6-a77b-45e4-a926-f9ed5188a0af service nova] Acquiring lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9fa3abea-d6c9-4112-bc4b-bc098897c712 req-acb42db6-a77b-45e4-a926-f9ed5188a0af service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9fa3abea-d6c9-4112-bc4b-bc098897c712 req-acb42db6-a77b-45e4-a926-f9ed5188a0af service nova] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG nova.compute.manager [req-9fa3abea-d6c9-4112-bc4b-bc098897c712 req-acb42db6-a77b-45e4-a926-f9ed5188a0af service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] No waiting events found dispatching network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:20:29 user nova-compute[75203]: WARNING nova.compute.manager [req-9fa3abea-d6c9-4112-bc4b-bc098897c712 req-acb42db6-a77b-45e4-a926-f9ed5188a0af service nova] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Received unexpected event network-vif-plugged-5874dcbc-2a50-4d8d-ae34-ac02c6ba23ed for instance with vm_state active and task_state deleting.
Nov 28 19:20:29 user nova-compute[75203]: INFO nova.compute.manager [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Took 0.79 seconds to detach 1 volumes for instance.
Nov 28 19:20:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d7283351-73bd-485c-b8d1-ba0269c1f20c] Deleting volume: cedcecd3-3d94-4e20-97ba-5f779239a18a {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:20:29 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:20:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:20:30 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Deleted allocations for instance d7283351-73bd-485c-b8d1-ba0269c1f20c
Nov 28 19:20:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-2930e84e-5a06-4658-80ec-b58fb933dd73 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d7283351-73bd-485c-b8d1-ba0269c1f20c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.839s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:20:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:20:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:20:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:20:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:20:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:20:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:20:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:20:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:10 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:21:10 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:21:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:21:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:21:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:21:13 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:21:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:21:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9147MB free_disk=24.922950744628906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:21:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:21:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:21:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:21:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:21:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:21:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:19 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:23 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:21:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:21:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:21:27 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:21:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d100395f-2c73-4c00-8150-6d98b646347f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:21:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:21:32 user nova-compute[75203]: INFO nova.compute.claims [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Claim successful on node user
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:21:32 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.policy [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c05ab9db4044e19fef91d0cab2ba03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31eb98a16d749d59528a72449f26c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:21:32 user nova-compute[75203]: INFO nova.virt.block_device [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Booting with volume 100f8822-cb49-46b4-90f3-85e1b80149a9 at /dev/vda
Nov 28 19:21:32 user nova-compute[75203]: DEBUG os_brick.utils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce44253-9658-4e1d-9979-950862c9b252]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[278c863c-a9ab-44f4-8db0-00d41ad20cf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fdaf5c-b717-4fd6-a20a-c046bf9037bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e75ce8a-59e9-4654-ad8b-6c0429630a2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:21:32 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:21:32 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54bd589-2589-470e-954f-0ee13197ff17]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG os_brick.utils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:21:32 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating existing volume attachment record: d809b80b-dff6-4dd2-9427-05b8d1b8d6ac {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Successfully created port: 00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Successfully updated port: 00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquired lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-changed-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Refreshing instance network info cache due to event network-changed-00c7d892-61b1-4fa1-9bcc-bd635f774188. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] Acquiring lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:21:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating instance_info_cache with network_info: [{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Releasing lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Instance network_info: |[{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] Acquired lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Refreshing network info cache for port 00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updated VIF entry in instance network info cache for port 00c7d892-61b1-4fa1-9bcc-bd635f774188. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG nova.network.neutron [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating instance_info_cache with network_info: [{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:21:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-44399aac-6d45-4e99-af0f-de5a34b2c60a req-d916666b-3293-40a5-8c6e-4434596b0a78 service nova] Releasing lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:21:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:21:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:21:39 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Creating image(s)
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Ensure instance console log exists: /opt/stack/data/nova/instances/d100395f-2c73-4c00-8150-6d98b646347f/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Start _get_guest_xml network_info=[{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNrXUDsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd100395f-2c73-4c00-8150-6d98b646347f', 'attached_at': '', 'detached_at': '', 'volume_id': '100f8822-cb49-46b4-90f3-85e1b80149a9', 'serial': '100f8822-cb49-46b4-90f3-85e1b80149a9'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'd809b80b-dff6-4dd2-9427-05b8d1b8d6ac', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:21:39 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:21:39 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNrXUDsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:21:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:21:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:21:39 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21f7ed5-5209-4c40-ba25-8356e8cb08ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:21:39 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[33570e1e-1d77-4d96-aeed-b0ddc0242d80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9] added
Nov 28 19:21:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede3ff60-10c8-43fe-9851-c042c31d76d0]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8f5ee-fbb2-4420-9c6a-d9d49d8516ec]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNrXUDsL {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pNrXUDsL" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c067cb1-98c1-4a95-b6f4-d91cf7973fa1]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pNrXUDsL'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4710bb3-4445-4221-a82d-ec4758043e9d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[59db0fdd-12cb-41c7-87ad-e1781e6cb428]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:21:39 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:21:39 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:21:39 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:21:39 user nova-compute[75203]: 
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f3b4a9-9a9b-4288-a08f-00ba635a69b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260]
Nov 28 19:21:39 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260] successful.
Nov 28 19:21:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3a14b0-e4c9-4217-b42d-a15d3d942bcf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6ca405-628d-4f60-b0c2-35020eaab9ee]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:21:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:21:39 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2431b68-7208-48fa-8d4e-9efed82672de]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:21:39 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNrXUDsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23338656161633763', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338656161633763', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1458695580',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1458695580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1458695580',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsxdDYIIedNTSMk0FEoPrVfvM9S1L7bEM1FAFGpJ59dSgA0wAq3Ez18N5P7K/RJlC6NDudkGh6ibUmZ5sTq53JvBi+44PZRBDLB4pA8bauZuUbwrUsZc6kshWqkWoou/w==',key_name='tempest-keypair-2035070243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-n143v3ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=d100395f-2c73-4c00-8150-6d98b646347f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:37:e4,bridge_name='br-int',has_traffic_filtering=True,id=00c7d892-61b1-4fa1-9bcc-bd635f774188,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7d892-61') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.objects.instance [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'pci_devices' on Instance uuid d100395f-2c73-4c00-8150-6d98b646347f {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:21:40 user nova-compute[75203]:   <uuid>d100395f-2c73-4c00-8150-6d98b646347f</uuid>
Nov 28 19:21:40 user nova-compute[75203]:   <name>instance-00000030</name>
Nov 28 19:21:40 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:21:40 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:21:40 user nova-compute[75203]:   <metadata>
Nov 28 19:21:40 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:21:40 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:21:40 user nova-compute[75203]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1458695580</nova:name>
Nov 28 19:21:40 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:21:39</nova:creationTime>
Nov 28 19:21:40 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:21:40 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:21:40 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:21:40 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:21:40 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:21:40 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:21:40 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:21:40 user nova-compute[75203]:       <nova:owner>
Nov 28 19:21:40 user nova-compute[75203]:         <nova:user uuid="a2c05ab9db4044e19fef91d0cab2ba03">tempest-TestVolumeBootPattern-1643995956-project-member</nova:user>
Nov 28 19:21:40 user nova-compute[75203]:         <nova:project uuid="e31eb98a16d749d59528a72449f26c46">tempest-TestVolumeBootPattern-1643995956</nova:project>
Nov 28 19:21:40 user nova-compute[75203]:       </nova:owner>
Nov 28 19:21:40 user nova-compute[75203]:       <nova:ports>
Nov 28 19:21:40 user nova-compute[75203]:         <nova:port uuid="00c7d892-61b1-4fa1-9bcc-bd635f774188">
Nov 28 19:21:40 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 28 19:21:40 user nova-compute[75203]:         </nova:port>
Nov 28 19:21:40 user nova-compute[75203]:       </nova:ports>
Nov 28 19:21:40 user nova-compute[75203]:     </nova:instance>
Nov 28 19:21:40 user nova-compute[75203]:   </metadata>
Nov 28 19:21:40 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:21:40 user nova-compute[75203]:     <system>
Nov 28 19:21:40 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:21:40 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:21:40 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:21:40 user nova-compute[75203]:       <entry name="serial">d100395f-2c73-4c00-8150-6d98b646347f</entry>
Nov 28 19:21:40 user nova-compute[75203]:       <entry name="uuid">d100395f-2c73-4c00-8150-6d98b646347f</entry>
Nov 28 19:21:40 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:21:40 user nova-compute[75203]:     </system>
Nov 28 19:21:40 user nova-compute[75203]:   </sysinfo>
Nov 28 19:21:40 user nova-compute[75203]:   <os>
Nov 28 19:21:40 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:21:40 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:21:40 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:21:40 user nova-compute[75203]:   </os>
Nov 28 19:21:40 user nova-compute[75203]:   <features>
Nov 28 19:21:40 user nova-compute[75203]:     <acpi/>
Nov 28 19:21:40 user nova-compute[75203]:     <apic/>
Nov 28 19:21:40 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:21:40 user nova-compute[75203]:   </features>
Nov 28 19:21:40 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:21:40 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:21:40 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:21:40 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:21:40 user nova-compute[75203]:   </clock>
Nov 28 19:21:40 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:21:40 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:21:40 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:21:40 user nova-compute[75203]:   </cpu>
Nov 28 19:21:40 user nova-compute[75203]:   <devices>
Nov 28 19:21:40 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:21:40 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:21:40 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 19:21:40 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:21:40 user nova-compute[75203]:       <serial>100f8822-cb49-46b4-90f3-85e1b80149a9</serial>
Nov 28 19:21:40 user nova-compute[75203]:     </disk>
Nov 28 19:21:40 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:21:40 user nova-compute[75203]:       <mac address="fa:16:3e:a5:37:e4"/>
Nov 28 19:21:40 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:21:40 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:21:40 user nova-compute[75203]:       <target dev="tap00c7d892-61"/>
Nov 28 19:21:40 user nova-compute[75203]:     </interface>
Nov 28 19:21:40 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:21:40 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/d100395f-2c73-4c00-8150-6d98b646347f/console.log" append="off"/>
Nov 28 19:21:40 user nova-compute[75203]:     </serial>
Nov 28 19:21:40 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:21:40 user nova-compute[75203]:     <video>
Nov 28 19:21:40 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:21:40 user nova-compute[75203]:     </video>
Nov 28 19:21:40 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:21:40 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:21:40 user nova-compute[75203]:     </rng>
Nov 28 19:21:40 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:21:40 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:21:40 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:21:40 user nova-compute[75203]:     </memballoon>
Nov 28 19:21:40 user nova-compute[75203]:   </devices>
Nov 28 19:21:40 user nova-compute[75203]: </domain>
Nov 28 19:21:40 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1458695580',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1458695580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1458695580',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsxdDYIIedNTSMk0FEoPrVfvM9S1L7bEM1FAFGpJ59dSgA0wAq3Ez18N5P7K/RJlC6NDudkGh6ibUmZ5sTq53JvBi+44PZRBDLB4pA8bauZuUbwrUsZc6kshWqkWoou/w==',key_name='tempest-keypair-2035070243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-n143v3ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:21:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=d100395f-2c73-4c00-8150-6d98b646347f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:37:e4,bridge_name='br-int',has_traffic_filtering=True,id=00c7d892-61b1-4fa1-9bcc-bd635f774188,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7d892-61') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG os_vif [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:37:e4,bridge_name='br-int',has_traffic_filtering=True,id=00c7d892-61b1-4fa1-9bcc-bd635f774188,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7d892-61') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a1c47ad-204e-56ca-ba7e-969eec700fa6', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00c7d892-61, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00c7d892-61, col_values=(('qos', UUID('178fbc73-c00b-4b56-a15c-9a374c7e1117')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00c7d892-61, col_values=(('external_ids', {'iface-id': '00c7d892-61b1-4fa1-9bcc-bd635f774188', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:37:e4', 'vm-uuid': 'd100395f-2c73-4c00-8150-6d98b646347f'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:40 user nova-compute[75203]: INFO os_vif [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:37:e4,bridge_name='br-int',has_traffic_filtering=True,id=00c7d892-61b1-4fa1-9bcc-bd635f774188,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7d892-61')
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:21:40 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No VIF found with MAC fa:16:3e:a5:37:e4, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-9da293cf-afcd-4abe-a48e-61ce9bbc518c req-41c34fe9-0a27-48b9-8886-3e604c38c4ef service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9da293cf-afcd-4abe-a48e-61ce9bbc518c req-41c34fe9-0a27-48b9-8886-3e604c38c4ef service nova] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9da293cf-afcd-4abe-a48e-61ce9bbc518c req-41c34fe9-0a27-48b9-8886-3e604c38c4ef service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9da293cf-afcd-4abe-a48e-61ce9bbc518c req-41c34fe9-0a27-48b9-8886-3e604c38c4ef service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG nova.compute.manager [req-9da293cf-afcd-4abe-a48e-61ce9bbc518c req-41c34fe9-0a27-48b9-8886-3e604c38c4ef service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] No waiting events found dispatching network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:21:42 user nova-compute[75203]: WARNING nova.compute.manager [req-9da293cf-afcd-4abe-a48e-61ce9bbc518c req-41c34fe9-0a27-48b9-8886-3e604c38c4ef service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received unexpected event network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 for instance with vm_state building and task_state spawning.
Nov 28 19:21:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:21:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Instance spawned successfully.
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-7c506e1c-931f-4825-9981-21195aa4f433 req-a504417f-a2bd-431f-ba6d-f5b22bbef644 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7c506e1c-931f-4825-9981-21195aa4f433 req-a504417f-a2bd-431f-ba6d-f5b22bbef644 service nova] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7c506e1c-931f-4825-9981-21195aa4f433 req-a504417f-a2bd-431f-ba6d-f5b22bbef644 service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7c506e1c-931f-4825-9981-21195aa4f433 req-a504417f-a2bd-431f-ba6d-f5b22bbef644 service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.compute.manager [req-7c506e1c-931f-4825-9981-21195aa4f433 req-a504417f-a2bd-431f-ba6d-f5b22bbef644 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] No waiting events found dispatching network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:21:44 user nova-compute[75203]: WARNING nova.compute.manager [req-7c506e1c-931f-4825-9981-21195aa4f433 req-a504417f-a2bd-431f-ba6d-f5b22bbef644 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received unexpected event network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 for instance with vm_state building and task_state spawning.
Nov 28 19:21:44 user nova-compute[75203]: INFO nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 28 19:21:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:21:44 user nova-compute[75203]: INFO nova.compute.manager [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Took 12.45 seconds to build instance.
Nov 28 19:21:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-b2a6e096-ad5b-4127-9f8f-50a8202e98d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d100395f-2c73-4c00-8150-6d98b646347f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.552s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:21:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:21:59 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:07 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_power_states {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:07 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid d100395f-2c73-4c00-8150-6d98b646347f {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 19:22:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:22:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "d100395f-2c73-4c00-8150-6d98b646347f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:22:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "d100395f-2c73-4c00-8150-6d98b646347f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:22:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:22:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:22:13 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:22:13 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:22:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:22:14 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:22:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.913066864013672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance d100395f-2c73-4c00-8150-6d98b646347f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:22:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:22:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:22:19 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:22:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:22:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:22:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:22:26 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:22:26 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid d100395f-2c73-4c00-8150-6d98b646347f {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:22:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating instance_info_cache with network_info: [{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:22:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:22:27 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:22:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:22:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:22:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:22:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:22:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:23:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:23:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:23:14 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:23:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:23:15 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:23:15 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:23:15 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=24.912521362304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance d100395f-2c73-4c00-8150-6d98b646347f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:23:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:19 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:19 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:23:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:21 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-changed-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG nova.compute.manager [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Refreshing instance network info cache due to event network-changed-00c7d892-61b1-4fa1-9bcc-bd635f774188. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] Acquiring lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] Acquired lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Refreshing network info cache for port 00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updated VIF entry in instance network info cache for port 00c7d892-61b1-4fa1-9bcc-bd635f774188. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG nova.network.neutron [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating instance_info_cache with network_info: [{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:23:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-d7d7e86f-86af-4013-ade0-d368fae5b5a5 req-0bcbd333-4c01-476d-ba9e-7547dcb203e2 service nova] Releasing lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:23:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:23:27 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid d100395f-2c73-4c00-8150-6d98b646347f {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:23:28 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating instance_info_cache with network_info: [{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:23:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:23:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:23:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:23:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "e002159a-1042-4a21-9ba1-9631be7ae886" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:23:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "e002159a-1042-4a21-9ba1-9631be7ae886" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:23:30 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:23:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:23:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:23:31 user nova-compute[75203]: INFO nova.compute.claims [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Claim successful on node user
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:23:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:23:31 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.network.neutron [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:23:31 user nova-compute[75203]: DEBUG nova.policy [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c05ab9db4044e19fef91d0cab2ba03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31eb98a16d749d59528a72449f26c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:23:31 user nova-compute[75203]: INFO nova.virt.block_device [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Booting with volume snapshot abcf237b-6431-4fe0-a509-a27673a086df at /dev/vda
Nov 28 19:23:32 user nova-compute[75203]: DEBUG nova.network.neutron [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Successfully created port: 0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Successfully updated port: 0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquired lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-changed-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.compute.manager [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Refreshing instance network info cache due to event network-changed-0f4ad4b6-71ea-4858-acc2-33f06884fa35. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] Acquiring lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updating instance_info_cache with network_info: [{"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Releasing lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Instance network_info: |[{"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] Acquired lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.network.neutron [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Refreshing network info cache for port 0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.network.neutron [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updated VIF entry in instance network info cache for port 0f4ad4b6-71ea-4858-acc2-33f06884fa35. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG nova.network.neutron [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updating instance_info_cache with network_info: [{"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:23:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0fc32c5a-5d79-42a4-91b9-6c288c7e357c req-6c2a2a73-567d-4559-9310-a5d3fd08f674 service nova] Releasing lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:23:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG os_brick.utils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9fd265-13b1-4430-91ee-eceed07c4f8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d9c70d-6596-4e57-8fe9-1539209a8fda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d5ce4a-337a-4af2-9685-27cd2ab3ea1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba0f08f-ab53-4689-8bcb-6ea2d027b61c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:23:37 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:23:37 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7895d09-0e2e-4f1d-a055-e81282b01229]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG os_brick.utils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:23:37 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updating existing volume attachment record: b690d618-9779-4a9c-a699-7b77b1cee597 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:23:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:23:44 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Creating image(s)
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Ensure instance console log exists: /opt/stack/data/nova/instances/e002159a-1042-4a21-9ba1-9631be7ae886/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Start _get_guest_xml network_info=[{"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T19:23:25Z,direct_url=<?>,disk_format='qcow2',id=c257f72c-daf8-4af7-9df8-2f16431972f5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1425978295',owner='e31eb98a16d749d59528a72449f26c46',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T19:23:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGgLpqPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e002159a-1042-4a21-9ba1-9631be7ae886', 'attached_at': '', 'detached_at': '', 'volume_id': 'b81f5156-d356-4d1d-bf4c-33b7671f3b4a', 'serial': 'b81f5156-d356-4d1d-bf4c-33b7671f3b4a'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'b690d618-9779-4a9c-a699-7b77b1cee597', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:23:44 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:23:44 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-28T19:23:25Z,direct_url=<?>,disk_format='qcow2',id=c257f72c-daf8-4af7-9df8-2f16431972f5,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1425978295',owner='e31eb98a16d749d59528a72449f26c46',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-28T19:23:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGgLpqPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:23:44 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:23:44 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:23:44 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[074669f0-6fb5-4735-ace4-7bd4f47dd960]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:23:44 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dda762-6226-42f2-a4d1-c23eae4a9788]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a] added
Nov 28 19:23:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c4a9f2-afbe-4fdf-8454-63a2eb940c88]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a85a4b2-2cc2-4dbc-b0b9-21ec38be4343]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGgLpqPd {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGgLpqPd" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f2fcc-6395-414b-a964-68b2ee869fa7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGgLpqPd'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[81accd8f-8139-4a3c-accb-56d0953eb9bf]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4ff81-adc3-4fea-a864-16b3a7033f42]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:23:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:23:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f7e317-588d-439d-bd47-b71473e55afd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260]
Nov 28 19:23:44 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260] successful.
Nov 28 19:23:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cefb96-88e1-47b6-9fcc-38f33500952e]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27e266b-79d4-4d30-8895-ef4fe0705093]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:23:44 user nova-compute[75203]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a (non-flash)
Nov 28 19:23:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:23:44 user nova-compute[75203]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a (non-flash)
Nov 28 19:23:44 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d292189d-26e7-43ce-9045-be879d9a7631]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:23:44 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGgLpqPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23333316661623738', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333316661623738', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1957462648',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1957462648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1957462648',id=49,image_ref='c257f72c-daf8-4af7-9df8-2f16431972f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKklIB19hQcEoSC23hKdXZNc3x6jVqcz50aGdaCuO06S7BpjtigZn1XVZ4ApR67kkdzz4L9tK9C0ZOhhOJJay1u4qdQN6kI7Hev4hHHyvvlvIwGGgEneKpv0zcRZmv6usA==',key_name='tempest-keypair-926510098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-dq9ey9wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1643995956',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=e002159a-1042-4a21-9ba1-9631be7ae886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:3c:54,bridge_name='br-int',has_traffic_filtering=True,id=0f4ad4b6-71ea-4858-acc2-33f06884fa35,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ad4b6-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.objects.instance [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'pci_devices' on Instance uuid e002159a-1042-4a21-9ba1-9631be7ae886 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:23:45 user nova-compute[75203]:   <uuid>e002159a-1042-4a21-9ba1-9631be7ae886</uuid>
Nov 28 19:23:45 user nova-compute[75203]:   <name>instance-00000031</name>
Nov 28 19:23:45 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:23:45 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:23:45 user nova-compute[75203]:   <metadata>
Nov 28 19:23:45 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:23:45 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:23:45 user nova-compute[75203]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1957462648</nova:name>
Nov 28 19:23:45 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:23:44</nova:creationTime>
Nov 28 19:23:45 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:23:45 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:23:45 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:23:45 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:23:45 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:23:45 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:23:45 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:23:45 user nova-compute[75203]:       <nova:owner>
Nov 28 19:23:45 user nova-compute[75203]:         <nova:user uuid="a2c05ab9db4044e19fef91d0cab2ba03">tempest-TestVolumeBootPattern-1643995956-project-member</nova:user>
Nov 28 19:23:45 user nova-compute[75203]:         <nova:project uuid="e31eb98a16d749d59528a72449f26c46">tempest-TestVolumeBootPattern-1643995956</nova:project>
Nov 28 19:23:45 user nova-compute[75203]:       </nova:owner>
Nov 28 19:23:45 user nova-compute[75203]:       <nova:root type="image" uuid="c257f72c-daf8-4af7-9df8-2f16431972f5"/>
Nov 28 19:23:45 user nova-compute[75203]:       <nova:ports>
Nov 28 19:23:45 user nova-compute[75203]:         <nova:port uuid="0f4ad4b6-71ea-4858-acc2-33f06884fa35">
Nov 28 19:23:45 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 19:23:45 user nova-compute[75203]:         </nova:port>
Nov 28 19:23:45 user nova-compute[75203]:       </nova:ports>
Nov 28 19:23:45 user nova-compute[75203]:     </nova:instance>
Nov 28 19:23:45 user nova-compute[75203]:   </metadata>
Nov 28 19:23:45 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:23:45 user nova-compute[75203]:     <system>
Nov 28 19:23:45 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:23:45 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:23:45 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:23:45 user nova-compute[75203]:       <entry name="serial">e002159a-1042-4a21-9ba1-9631be7ae886</entry>
Nov 28 19:23:45 user nova-compute[75203]:       <entry name="uuid">e002159a-1042-4a21-9ba1-9631be7ae886</entry>
Nov 28 19:23:45 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:23:45 user nova-compute[75203]:     </system>
Nov 28 19:23:45 user nova-compute[75203]:   </sysinfo>
Nov 28 19:23:45 user nova-compute[75203]:   <os>
Nov 28 19:23:45 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:23:45 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:23:45 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:23:45 user nova-compute[75203]:   </os>
Nov 28 19:23:45 user nova-compute[75203]:   <features>
Nov 28 19:23:45 user nova-compute[75203]:     <acpi/>
Nov 28 19:23:45 user nova-compute[75203]:     <apic/>
Nov 28 19:23:45 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:23:45 user nova-compute[75203]:   </features>
Nov 28 19:23:45 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:23:45 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:23:45 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:23:45 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:23:45 user nova-compute[75203]:   </clock>
Nov 28 19:23:45 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:23:45 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:23:45 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:23:45 user nova-compute[75203]:   </cpu>
Nov 28 19:23:45 user nova-compute[75203]:   <devices>
Nov 28 19:23:45 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:23:45 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:23:45 user nova-compute[75203]:       <source dev="/dev/sdc"/>
Nov 28 19:23:45 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:23:45 user nova-compute[75203]:       <serial>b81f5156-d356-4d1d-bf4c-33b7671f3b4a</serial>
Nov 28 19:23:45 user nova-compute[75203]:     </disk>
Nov 28 19:23:45 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:23:45 user nova-compute[75203]:       <mac address="fa:16:3e:ce:3c:54"/>
Nov 28 19:23:45 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:23:45 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:23:45 user nova-compute[75203]:       <target dev="tap0f4ad4b6-71"/>
Nov 28 19:23:45 user nova-compute[75203]:     </interface>
Nov 28 19:23:45 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:23:45 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/e002159a-1042-4a21-9ba1-9631be7ae886/console.log" append="off"/>
Nov 28 19:23:45 user nova-compute[75203]:     </serial>
Nov 28 19:23:45 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:23:45 user nova-compute[75203]:     <video>
Nov 28 19:23:45 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:23:45 user nova-compute[75203]:     </video>
Nov 28 19:23:45 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:23:45 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:23:45 user nova-compute[75203]:     </rng>
Nov 28 19:23:45 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:23:45 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:23:45 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:23:45 user nova-compute[75203]:     </memballoon>
Nov 28 19:23:45 user nova-compute[75203]:   </devices>
Nov 28 19:23:45 user nova-compute[75203]: </domain>
Nov 28 19:23:45 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1957462648',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1957462648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1957462648',id=49,image_ref='c257f72c-daf8-4af7-9df8-2f16431972f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKklIB19hQcEoSC23hKdXZNc3x6jVqcz50aGdaCuO06S7BpjtigZn1XVZ4ApR67kkdzz4L9tK9C0ZOhhOJJay1u4qdQN6kI7Hev4hHHyvvlvIwGGgEneKpv0zcRZmv6usA==',key_name='tempest-keypair-926510098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-dq9ey9wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1643995956',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=e002159a-1042-4a21-9ba1-9631be7ae886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:3c:54,bridge_name='br-int',has_traffic_filtering=True,id=0f4ad4b6-71ea-4858-acc2-33f06884fa35,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ad4b6-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG os_vif [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:3c:54,bridge_name='br-int',has_traffic_filtering=True,id=0f4ad4b6-71ea-4858-acc2-33f06884fa35,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ad4b6-71') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26ef80a7-f61e-5fc4-b973-a30c19aef548', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f4ad4b6-71, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f4ad4b6-71, col_values=(('qos', UUID('4f6ceded-a612-486c-842e-c838f0e15d3e')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f4ad4b6-71, col_values=(('external_ids', {'iface-id': '0f4ad4b6-71ea-4858-acc2-33f06884fa35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:3c:54', 'vm-uuid': 'e002159a-1042-4a21-9ba1-9631be7ae886'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:45 user nova-compute[75203]: INFO os_vif [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:3c:54,bridge_name='br-int',has_traffic_filtering=True,id=0f4ad4b6-71ea-4858-acc2-33f06884fa35,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ad4b6-71')
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:23:45 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No VIF found with MAC fa:16:3e:ce:3c:54, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:23:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:47 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-2b3f0adb-39b6-46f2-84d0-126319fccc06 req-b0e81142-46c8-49cb-83af-0720d638dd19 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:23:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2b3f0adb-39b6-46f2-84d0-126319fccc06 req-b0e81142-46c8-49cb-83af-0720d638dd19 service nova] Acquiring lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:23:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2b3f0adb-39b6-46f2-84d0-126319fccc06 req-b0e81142-46c8-49cb-83af-0720d638dd19 service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:23:47 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-2b3f0adb-39b6-46f2-84d0-126319fccc06 req-b0e81142-46c8-49cb-83af-0720d638dd19 service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:23:47 user nova-compute[75203]: DEBUG nova.compute.manager [req-2b3f0adb-39b6-46f2-84d0-126319fccc06 req-b0e81142-46c8-49cb-83af-0720d638dd19 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] No waiting events found dispatching network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:23:47 user nova-compute[75203]: WARNING nova.compute.manager [req-2b3f0adb-39b6-46f2-84d0-126319fccc06 req-b0e81142-46c8-49cb-83af-0720d638dd19 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received unexpected event network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 for instance with vm_state building and task_state spawning.
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:23:49 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Instance spawned successfully.
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:23:49 user nova-compute[75203]: INFO nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:49 user nova-compute[75203]: INFO nova.compute.manager [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Took 18.25 seconds to build instance.
Nov 28 19:23:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-edf7074e-2c84-42e0-83b4-e5ac57472d15 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "e002159a-1042-4a21-9ba1-9631be7ae886" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.345s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-7bd2187b-7842-46b1-bb62-50f0846834c0 req-14d73ef4-59dd-4693-b2a6-0d487b63805c service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7bd2187b-7842-46b1-bb62-50f0846834c0 req-14d73ef4-59dd-4693-b2a6-0d487b63805c service nova] Acquiring lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7bd2187b-7842-46b1-bb62-50f0846834c0 req-14d73ef4-59dd-4693-b2a6-0d487b63805c service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-7bd2187b-7842-46b1-bb62-50f0846834c0 req-14d73ef4-59dd-4693-b2a6-0d487b63805c service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:23:49 user nova-compute[75203]: DEBUG nova.compute.manager [req-7bd2187b-7842-46b1-bb62-50f0846834c0 req-14d73ef4-59dd-4693-b2a6-0d487b63805c service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] No waiting events found dispatching network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:23:49 user nova-compute[75203]: WARNING nova.compute.manager [req-7bd2187b-7842-46b1-bb62-50f0846834c0 req-14d73ef4-59dd-4693-b2a6-0d487b63805c service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received unexpected event network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 for instance with vm_state active and task_state None.
Nov 28 19:23:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:23:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:16 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:24:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:24:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:24:16 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:24:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:24:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:24:17 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:24:17 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8840MB free_disk=24.910438537597656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance d100395f-2c73-4c00-8150-6d98b646347f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e002159a-1042-4a21-9ba1-9631be7ae886 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:24:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:24:19 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:24:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:23 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:27 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:27 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:24:27 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:24:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:24:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:24:27 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:24:27 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid d100395f-2c73-4c00-8150-6d98b646347f {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:24:28 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating instance_info_cache with network_info: [{"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:24:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-d100395f-2c73-4c00-8150-6d98b646347f" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:24:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:24:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:24:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:24:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:24:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:25:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:25:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:25:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:16 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:25:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:25:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:25:16 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:25:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:25:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:25:17 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:25:17 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=24.909866333007812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance d100395f-2c73-4c00-8150-6d98b646347f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance e002159a-1042-4a21-9ba1-9631be7ae886 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:25:17 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:25:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:20 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:25:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:21 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-changed-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:25:21 user nova-compute[75203]: DEBUG nova.compute.manager [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Refreshing instance network info cache due to event network-changed-0f4ad4b6-71ea-4858-acc2-33f06884fa35. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:25:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] Acquiring lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:25:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] Acquired lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:25:21 user nova-compute[75203]: DEBUG nova.network.neutron [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Refreshing network info cache for port 0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "e002159a-1042-4a21-9ba1-9631be7ae886" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "e002159a-1042-4a21-9ba1-9631be7ae886" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:25:22 user nova-compute[75203]: INFO nova.compute.manager [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Terminating instance
Nov 28 19:25:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updated VIF entry in instance network info cache for port 0f4ad4b6-71ea-4858-acc2-33f06884fa35. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG nova.network.neutron [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updating instance_info_cache with network_info: [{"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fbf67e16-27a0-4834-89f2-ee0f2d0d81d6 req-0b0ec0b2-2ca9-473d-876b-8156175e09ab service nova] Releasing lock "refresh_cache-e002159a-1042-4a21-9ba1-9631be7ae886" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-c434ffe3-858e-496c-9383-93f71330e23f req-57794afe-259d-47b3-9fd0-dc33c4dfa80a service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-vif-unplugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c434ffe3-858e-496c-9383-93f71330e23f req-57794afe-259d-47b3-9fd0-dc33c4dfa80a service nova] Acquiring lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c434ffe3-858e-496c-9383-93f71330e23f req-57794afe-259d-47b3-9fd0-dc33c4dfa80a service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-c434ffe3-858e-496c-9383-93f71330e23f req-57794afe-259d-47b3-9fd0-dc33c4dfa80a service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-c434ffe3-858e-496c-9383-93f71330e23f req-57794afe-259d-47b3-9fd0-dc33c4dfa80a service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] No waiting events found dispatching network-vif-unplugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG nova.compute.manager [req-c434ffe3-858e-496c-9383-93f71330e23f req-57794afe-259d-47b3-9fd0-dc33c4dfa80a service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-vif-unplugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Instance destroyed successfully.
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.objects.instance [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'resources' on Instance uuid e002159a-1042-4a21-9ba1-9631be7ae886 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1957462648',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1957462648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1957462648',id=49,image_ref='c257f72c-daf8-4af7-9df8-2f16431972f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKklIB19hQcEoSC23hKdXZNc3x6jVqcz50aGdaCuO06S7BpjtigZn1XVZ4ApR67kkdzz4L9tK9C0ZOhhOJJay1u4qdQN6kI7Hev4hHHyvvlvIwGGgEneKpv0zcRZmv6usA==',key_name='tempest-keypair-926510098',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:23:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-dq9ey9wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1643995956',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=e002159a-1042-4a21-9ba1-9631be7ae886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "address": "fa:16:3e:ce:3c:54", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ad4b6-71", "ovs_interfaceid": "0f4ad4b6-71ea-4858-acc2-33f06884fa35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:3c:54,bridge_name='br-int',has_traffic_filtering=True,id=0f4ad4b6-71ea-4858-acc2-33f06884fa35,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ad4b6-71') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_vif [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:3c:54,bridge_name='br-int',has_traffic_filtering=True,id=0f4ad4b6-71ea-4858-acc2-33f06884fa35,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ad4b6-71') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f4ad4b6-71, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f6ceded-a612-486c-842e-c838f0e15d3e) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:23 user nova-compute[75203]: INFO os_vif [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:3c:54,bridge_name='br-int',has_traffic_filtering=True,id=0f4ad4b6-71ea-4858-acc2-33f06884fa35,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ad4b6-71')
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGgLpqPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:25:23 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e31fc-5f26-4d42-a473-48f0e8f57896]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:25:23 user nova-compute[75203]: No targets found.
Nov 28 19:25:23 user nova-compute[75203]: iSNS:
Nov 28 19:25:23 user nova-compute[75203]: No targets found.
Nov 28 19:25:23 user nova-compute[75203]: STATIC:
Nov 28 19:25:23 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9
Nov 28 19:25:23 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:25:23 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:25:23 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a
Nov 28 19:25:23 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:25:23 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:25:23 user nova-compute[75203]: FIRMWARE:
Nov 28 19:25:23 user nova-compute[75203]: No targets found.
Nov 28 19:25:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:25:23 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:25:23 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a837274-f5ab-4868-8ac7-65f54762ffb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70fa282-9b83-483a-9b4f-dd3725875ca6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:25:23 user nova-compute[75203]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a (non-flash)
Nov 28 19:25:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:25:23 user nova-compute[75203]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a (non-flash)
Nov 28 19:25:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903c2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184f32a-4460-4ffc-980c-6262ace94a12]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b17d5-2046-4018-af88-2623d506c7c3]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f37c34-9994-461f-922c-27e4f56cf132]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e39270-9cb6-4fcd-a54a-f3b4570fffdf]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_94710351',) {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c25f44-bfe2-45b5-a2db-5a764911d36e]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[548dcf8a-b6f5-45bb-8aa5-e8be3934c1d7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[288dc624-a271-40bd-8fb1-fdff00659aac]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260]
Nov 28 19:25:23 user nova-compute[75203]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a, portal: 172.16.0.220,3260] successful.
Nov 28 19:25:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b81f5156-d356-4d1d-bf4c-33b7671f3b4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76775f6-3353-4f2c-aa3f-39c058aada7f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== disconnect_volume: return (303ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:25:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Deleting instance files /opt/stack/data/nova/instances/e002159a-1042-4a21-9ba1-9631be7ae886_del
Nov 28 19:25:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Deletion of /opt/stack/data/nova/instances/e002159a-1042-4a21-9ba1-9631be7ae886_del complete
Nov 28 19:25:23 user nova-compute[75203]: INFO nova.compute.manager [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 28 19:25:23 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:25:23 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:24 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Took 0.74 seconds to deallocate network for instance.
Nov 28 19:25:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-6a9d37cf-1186-4e65-b5c6-005009fe220c req-b1991199-089e-4e65-9db0-f7ac1f1773ca service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-vif-deleted-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:25:24 user nova-compute[75203]: INFO nova.compute.manager [req-6a9d37cf-1186-4e65-b5c6-005009fe220c req-b1991199-089e-4e65-9db0-f7ac1f1773ca service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Neutron deleted interface 0f4ad4b6-71ea-4858-acc2-33f06884fa35; detaching it from the instance and deleting it from the info cache
Nov 28 19:25:24 user nova-compute[75203]: DEBUG nova.network.neutron [req-6a9d37cf-1186-4e65-b5c6-005009fe220c req-b1991199-089e-4e65-9db0-f7ac1f1773ca service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-6a9d37cf-1186-4e65-b5c6-005009fe220c req-b1991199-089e-4e65-9db0-f7ac1f1773ca service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Detach interface failed, port_id=0f4ad4b6-71ea-4858-acc2-33f06884fa35, reason: Instance e002159a-1042-4a21-9ba1-9631be7ae886 could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-9d692fa9-27e7-44b0-9a2b-173b7d1e40e4 req-71dbd72f-990f-41c4-a09b-afa468934dd5 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received event network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9d692fa9-27e7-44b0-9a2b-173b7d1e40e4 req-71dbd72f-990f-41c4-a09b-afa468934dd5 service nova] Acquiring lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9d692fa9-27e7-44b0-9a2b-173b7d1e40e4 req-71dbd72f-990f-41c4-a09b-afa468934dd5 service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9d692fa9-27e7-44b0-9a2b-173b7d1e40e4 req-71dbd72f-990f-41c4-a09b-afa468934dd5 service nova] Lock "e002159a-1042-4a21-9ba1-9631be7ae886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:25:24 user nova-compute[75203]: DEBUG nova.compute.manager [req-9d692fa9-27e7-44b0-9a2b-173b7d1e40e4 req-71dbd72f-990f-41c4-a09b-afa468934dd5 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] No waiting events found dispatching network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:25:24 user nova-compute[75203]: WARNING nova.compute.manager [req-9d692fa9-27e7-44b0-9a2b-173b7d1e40e4 req-71dbd72f-990f-41c4-a09b-afa468934dd5 service nova] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Received unexpected event network-vif-plugged-0f4ad4b6-71ea-4858-acc2-33f06884fa35 for instance with vm_state active and task_state deleting.
Nov 28 19:25:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:24 user nova-compute[75203]: INFO nova.compute.manager [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 19:25:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: e002159a-1042-4a21-9ba1-9631be7ae886] Deleting volume: b81f5156-d356-4d1d-bf4c-33b7671f3b4a {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 19:25:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:25:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:25:25 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:25:25 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:25:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:25:25 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Deleted allocations for instance e002159a-1042-4a21-9ba1-9631be7ae886
Nov 28 19:25:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0429d4ae-0b58-41b8-a79f-aa075d6804f3 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "e002159a-1042-4a21-9ba1-9631be7ae886" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.059s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:25:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:28 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:25:29 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:25:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:25:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:25:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:25:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:26:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:26:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:26:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:26:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:26:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:26:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:26:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d100395f-2c73-4c00-8150-6d98b646347f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:26:16 user nova-compute[75203]: INFO nova.compute.manager [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Terminating instance
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-0bee226d-a52f-40a0-82f3-b22fa3741a76 req-84f34e85-f3eb-46e8-a043-91b42f985bed service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-vif-unplugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0bee226d-a52f-40a0-82f3-b22fa3741a76 req-84f34e85-f3eb-46e8-a043-91b42f985bed service nova] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0bee226d-a52f-40a0-82f3-b22fa3741a76 req-84f34e85-f3eb-46e8-a043-91b42f985bed service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-0bee226d-a52f-40a0-82f3-b22fa3741a76 req-84f34e85-f3eb-46e8-a043-91b42f985bed service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-0bee226d-a52f-40a0-82f3-b22fa3741a76 req-84f34e85-f3eb-46e8-a043-91b42f985bed service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] No waiting events found dispatching network-vif-unplugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.compute.manager [req-0bee226d-a52f-40a0-82f3-b22fa3741a76 req-84f34e85-f3eb-46e8-a043-91b42f985bed service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-vif-unplugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:26:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Instance destroyed successfully.
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.objects.instance [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'resources' on Instance uuid d100395f-2c73-4c00-8150-6d98b646347f {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1458695580',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1458695580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1458695580',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsxdDYIIedNTSMk0FEoPrVfvM9S1L7bEM1FAFGpJ59dSgA0wAq3Ez18N5P7K/RJlC6NDudkGh6ibUmZ5sTq53JvBi+44PZRBDLB4pA8bauZuUbwrUsZc6kshWqkWoou/w==',key_name='tempest-keypair-2035070243',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-n143v3ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=d100395f-2c73-4c00-8150-6d98b646347f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "address": "fa:16:3e:a5:37:e4", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7d892-61", "ovs_interfaceid": "00c7d892-61b1-4fa1-9bcc-bd635f774188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:37:e4,bridge_name='br-int',has_traffic_filtering=True,id=00c7d892-61b1-4fa1-9bcc-bd635f774188,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7d892-61') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_vif [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:37:e4,bridge_name='br-int',has_traffic_filtering=True,id=00c7d892-61b1-4fa1-9bcc-bd635f774188,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7d892-61') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00c7d892-61, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=178fbc73-c00b-4b56-a15c-9a374c7e1117) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:16 user nova-compute[75203]: INFO os_vif [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:37:e4,bridge_name='br-int',has_traffic_filtering=True,id=00c7d892-61b1-4fa1-9bcc-bd635f774188,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7d892-61')
Nov 28 19:26:16 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pNrXUDsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:26:16 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7803161b-d09b-4433-990f-4fd2556ea18d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:26:16 user nova-compute[75203]: No targets found.
Nov 28 19:26:16 user nova-compute[75203]: iSNS:
Nov 28 19:26:16 user nova-compute[75203]: No targets found.
Nov 28 19:26:16 user nova-compute[75203]: STATIC:
Nov 28 19:26:16 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9
Nov 28 19:26:16 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:26:16 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:26:16 user nova-compute[75203]: FIRMWARE:
Nov 28 19:26:16 user nova-compute[75203]: No targets found.
Nov 28 19:26:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:26:16 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:26:16 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9144b9c-89d2-4617-aea1-328dab3cf62a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d65d72-2f0f-4796-8adb-1d13c86bee62]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:26:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 (non-flash)
Nov 28 19:26:16 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07903c2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb5419-22db-4c17-9d78-2592063c5df1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3dcbdf-a65b-4b81-a71d-f2272b710a2e]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bcb11a-4143-4c6e-b4fe-a42ed16bdc28]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c21ab62-5947-4504-8c38-fd8a9181b0c4]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac69782-6133-41ff-8fad-c1536cbba2ff]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1c3367-5031-4e5e-b8ab-ea1d6f200b61]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260]
Nov 28 19:26:17 user nova-compute[75203]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9, portal: 172.16.0.220,3260] successful.
Nov 28 19:26:17 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:100f8822-cb49-46b4-90f3-85e1b80149a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5f5edb-3a9e-4f1f-8be4-b7fa8ccd74c8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== disconnect_volume: return (350ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:26:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Deleting instance files /opt/stack/data/nova/instances/d100395f-2c73-4c00-8150-6d98b646347f_del
Nov 28 19:26:17 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Deletion of /opt/stack/data/nova/instances/d100395f-2c73-4c00-8150-6d98b646347f_del complete
Nov 28 19:26:17 user nova-compute[75203]: INFO nova.compute.manager [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 28 19:26:17 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:26:17 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: d100395f-2c73-4c00-8150-6d98b646347f] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:26:18 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Took 0.79 seconds to deallocate network for instance.
Nov 28 19:26:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-3997beb5-fa81-4c26-a2b0-0aedbfba50f7 req-bc63e83c-7e2a-496e-b52a-61dcc282c61c service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3997beb5-fa81-4c26-a2b0-0aedbfba50f7 req-bc63e83c-7e2a-496e-b52a-61dcc282c61c service nova] Acquiring lock "d100395f-2c73-4c00-8150-6d98b646347f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3997beb5-fa81-4c26-a2b0-0aedbfba50f7 req-bc63e83c-7e2a-496e-b52a-61dcc282c61c service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3997beb5-fa81-4c26-a2b0-0aedbfba50f7 req-bc63e83c-7e2a-496e-b52a-61dcc282c61c service nova] Lock "d100395f-2c73-4c00-8150-6d98b646347f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-3997beb5-fa81-4c26-a2b0-0aedbfba50f7 req-bc63e83c-7e2a-496e-b52a-61dcc282c61c service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] No waiting events found dispatching network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:26:18 user nova-compute[75203]: WARNING nova.compute.manager [req-3997beb5-fa81-4c26-a2b0-0aedbfba50f7 req-bc63e83c-7e2a-496e-b52a-61dcc282c61c service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received unexpected event network-vif-plugged-00c7d892-61b1-4fa1-9bcc-bd635f774188 for instance with vm_state active and task_state deleting.
Nov 28 19:26:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-3997beb5-fa81-4c26-a2b0-0aedbfba50f7 req-bc63e83c-7e2a-496e-b52a-61dcc282c61c service nova] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Received event network-vif-deleted-00c7d892-61b1-4fa1-9bcc-bd635f774188 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:18 user nova-compute[75203]: INFO nova.compute.manager [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 19:26:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:26:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: d100395f-2c73-4c00-8150-6d98b646347f] Deleting volume: 100f8822-cb49-46b4-90f3-85e1b80149a9 {{(pid=75203) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:26:19 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:26:19 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9119MB free_disk=24.908824920654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.274s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:26:19 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Deleted allocations for instance d100395f-2c73-4c00-8150-6d98b646347f
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-0b9d76ad-41b6-4478-8b0b-4fd6660f2949 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "d100395f-2c73-4c00-8150-6d98b646347f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.544s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:26:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:26:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:21 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:21 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:26:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:26:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:26:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:26:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:26:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:26:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:26:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:26:42 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:26:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:26:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:26:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:27:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:06 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:27:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:27:15 user nova-compute[75203]: INFO nova.compute.claims [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Claim successful on node user
Nov 28 19:27:15 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:27:15 user nova-compute[75203]: DEBUG nova.network.neutron [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:27:16 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:27:16 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:27:16 user nova-compute[75203]: INFO nova.virt.block_device [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Booting with volume 13b35c98-24f4-40d8-a805-2f950c060f65 at /dev/vda
Nov 28 19:27:16 user nova-compute[75203]: DEBUG nova.policy [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c05ab9db4044e19fef91d0cab2ba03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31eb98a16d749d59528a72449f26c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG os_brick.utils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0961e21-9f52-45de-b406-13b3df2e820d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ac7acb-66eb-4243-beb9-91d7f874ba9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f414fd-0ded-4927-a11a-cf2c5db464b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1a9733-13d4-4c27-bfcc-4454fd0502fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:27:16 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:27:16 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2dee08-4be0-4fe7-8349-e258050b3642]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG os_brick.utils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating existing volume attachment record: 01e9a8e2-d593-4bc8-88a7-841c8f2c2ec2 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:16 user nova-compute[75203]: DEBUG nova.network.neutron [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Successfully created port: 7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Successfully updated port: 7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquired lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-changed-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.compute.manager [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Refreshing instance network info cache due to event network-changed-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] Acquiring lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.network.neutron [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating instance_info_cache with network_info: [{"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Releasing lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Instance network_info: |[{"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] Acquired lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:27:18 user nova-compute[75203]: DEBUG nova.network.neutron [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Refreshing network info cache for port 7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:27:19 user nova-compute[75203]: DEBUG nova.network.neutron [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updated VIF entry in instance network info cache for port 7b24bb1b-3fd4-4fd0-8d9a-a887231691b7. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:27:19 user nova-compute[75203]: DEBUG nova.network.neutron [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating instance_info_cache with network_info: [{"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:27:19 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-9cf26fa0-8eb3-41f4-ba9c-3060ac96d136 req-23b17461-cbdb-4843-8ee9-48ad617d9ba9 service nova] Releasing lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:27:19 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:20 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:27:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:27:20 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:27:20 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:27:21 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:27:21 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:27:21 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9138MB free_disk=24.907405853271484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance afa6449c-33ec-4fda-8680-fd2b07dd8ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:27:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:27:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:22 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:27:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:27:23 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Creating image(s)
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Ensure instance console log exists: /opt/stack/data/nova/instances/afa6449c-33ec-4fda-8680-fd2b07dd8ede/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Start _get_guest_xml network_info=[{"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'afa6449c-33ec-4fda-8680-fd2b07dd8ede', 'attached_at': '', 'detached_at': '', 'volume_id': '13b35c98-24f4-40d8-a805-2f950c060f65', 'serial': '13b35c98-24f4-40d8-a805-2f950c060f65'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '01e9a8e2-d593-4bc8-88a7-841c8f2c2ec2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:27:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:27:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:27:23 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:27:23 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:27:23 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[644bb5c1-32ba-4636-aa62-65492899ee3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:27:23 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bfe7dd-b6c9-43a0-ba4a-7ab2a2b4533e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65] added
Nov 28 19:27:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660f241-3f89-423a-b001-2d5fed05f45f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebfea3e-a8d0-4bfe-89d9-9b1243910e3d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHMiknQO {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHMiknQO" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52fedf-e66b-4a0a-9629-2ce367f21c0a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oHMiknQO'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe717b61-d318-4f3c-8f16-cc02feafaa7f]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd940e7-9db3-4ddd-bbaf-337e790b9557]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:27:23 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:27:23 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:27:23 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:27:23 user nova-compute[75203]: 
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd95e69f-bace-4d65-bed1-38f311a5b6a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]
Nov 28 19:27:23 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.
Nov 28 19:27:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4b67ed-ce29-4d02-8fa4-973df99b6455]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32a34b1-2366-4281-a544-900778dd837e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:27:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:27:23 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eadd430-f0af-451a-88bb-c96cb12c0bcc]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:27:23 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23637616366623766', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637616366623766', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1400893156',display_name='tempest-TestVolumeBootPattern-server-1400893156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1400893156',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-3qmf8cg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:27:16Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=afa6449c-33ec-4fda-8680-fd2b07dd8ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ac:37,bridge_name='br-int',has_traffic_filtering=True,id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b24bb1b-3f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:27:24 user nova-compute[75203]: DEBUG nova.objects.instance [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'pci_devices' on Instance uuid afa6449c-33ec-4fda-8680-fd2b07dd8ede {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:27:25 user nova-compute[75203]:   <uuid>afa6449c-33ec-4fda-8680-fd2b07dd8ede</uuid>
Nov 28 19:27:25 user nova-compute[75203]:   <name>instance-00000032</name>
Nov 28 19:27:25 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:27:25 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:27:25 user nova-compute[75203]:   <metadata>
Nov 28 19:27:25 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:27:25 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:27:25 user nova-compute[75203]:       <nova:name>tempest-TestVolumeBootPattern-server-1400893156</nova:name>
Nov 28 19:27:25 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:27:23</nova:creationTime>
Nov 28 19:27:25 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:27:25 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:27:25 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:27:25 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:27:25 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:27:25 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:27:25 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:27:25 user nova-compute[75203]:       <nova:owner>
Nov 28 19:27:25 user nova-compute[75203]:         <nova:user uuid="a2c05ab9db4044e19fef91d0cab2ba03">tempest-TestVolumeBootPattern-1643995956-project-member</nova:user>
Nov 28 19:27:25 user nova-compute[75203]:         <nova:project uuid="e31eb98a16d749d59528a72449f26c46">tempest-TestVolumeBootPattern-1643995956</nova:project>
Nov 28 19:27:25 user nova-compute[75203]:       </nova:owner>
Nov 28 19:27:25 user nova-compute[75203]:       <nova:ports>
Nov 28 19:27:25 user nova-compute[75203]:         <nova:port uuid="7b24bb1b-3fd4-4fd0-8d9a-a887231691b7">
Nov 28 19:27:25 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 28 19:27:25 user nova-compute[75203]:         </nova:port>
Nov 28 19:27:25 user nova-compute[75203]:       </nova:ports>
Nov 28 19:27:25 user nova-compute[75203]:     </nova:instance>
Nov 28 19:27:25 user nova-compute[75203]:   </metadata>
Nov 28 19:27:25 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:27:25 user nova-compute[75203]:     <system>
Nov 28 19:27:25 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:27:25 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:27:25 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:27:25 user nova-compute[75203]:       <entry name="serial">afa6449c-33ec-4fda-8680-fd2b07dd8ede</entry>
Nov 28 19:27:25 user nova-compute[75203]:       <entry name="uuid">afa6449c-33ec-4fda-8680-fd2b07dd8ede</entry>
Nov 28 19:27:25 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:27:25 user nova-compute[75203]:     </system>
Nov 28 19:27:25 user nova-compute[75203]:   </sysinfo>
Nov 28 19:27:25 user nova-compute[75203]:   <os>
Nov 28 19:27:25 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:27:25 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:27:25 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:27:25 user nova-compute[75203]:   </os>
Nov 28 19:27:25 user nova-compute[75203]:   <features>
Nov 28 19:27:25 user nova-compute[75203]:     <acpi/>
Nov 28 19:27:25 user nova-compute[75203]:     <apic/>
Nov 28 19:27:25 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:27:25 user nova-compute[75203]:   </features>
Nov 28 19:27:25 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:27:25 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:27:25 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:27:25 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:27:25 user nova-compute[75203]:   </clock>
Nov 28 19:27:25 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:27:25 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:27:25 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:27:25 user nova-compute[75203]:   </cpu>
Nov 28 19:27:25 user nova-compute[75203]:   <devices>
Nov 28 19:27:25 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:27:25 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:27:25 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 19:27:25 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:27:25 user nova-compute[75203]:       <serial>13b35c98-24f4-40d8-a805-2f950c060f65</serial>
Nov 28 19:27:25 user nova-compute[75203]:     </disk>
Nov 28 19:27:25 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:27:25 user nova-compute[75203]:       <mac address="fa:16:3e:5c:ac:37"/>
Nov 28 19:27:25 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:27:25 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:27:25 user nova-compute[75203]:       <target dev="tap7b24bb1b-3f"/>
Nov 28 19:27:25 user nova-compute[75203]:     </interface>
Nov 28 19:27:25 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:27:25 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/afa6449c-33ec-4fda-8680-fd2b07dd8ede/console.log" append="off"/>
Nov 28 19:27:25 user nova-compute[75203]:     </serial>
Nov 28 19:27:25 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:27:25 user nova-compute[75203]:     <video>
Nov 28 19:27:25 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:27:25 user nova-compute[75203]:     </video>
Nov 28 19:27:25 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:27:25 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:27:25 user nova-compute[75203]:     </rng>
Nov 28 19:27:25 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:27:25 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:27:25 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:27:25 user nova-compute[75203]:     </memballoon>
Nov 28 19:27:25 user nova-compute[75203]:   </devices>
Nov 28 19:27:25 user nova-compute[75203]: </domain>
Nov 28 19:27:25 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1400893156',display_name='tempest-TestVolumeBootPattern-server-1400893156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1400893156',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-3qmf8cg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:27:16Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=afa6449c-33ec-4fda-8680-fd2b07dd8ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ac:37,bridge_name='br-int',has_traffic_filtering=True,id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b24bb1b-3f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG os_vif [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ac:37,bridge_name='br-int',has_traffic_filtering=True,id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b24bb1b-3f') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b02c97f1-5ef2-5c5a-8c31-d574ceb018f5', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b24bb1b-3f, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b24bb1b-3f, col_values=(('qos', UUID('ab15a819-ed48-4bf0-a933-053dc3099cc0')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b24bb1b-3f, col_values=(('external_ids', {'iface-id': '7b24bb1b-3fd4-4fd0-8d9a-a887231691b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:ac:37', 'vm-uuid': 'afa6449c-33ec-4fda-8680-fd2b07dd8ede'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:25 user nova-compute[75203]: INFO os_vif [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ac:37,bridge_name='br-int',has_traffic_filtering=True,id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b24bb1b-3f')
Nov 28 19:27:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:27:25 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No VIF found with MAC fa:16:3e:5c:ac:37, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-8d8031b9-3e32-452b-8698-9fe52b650d80 req-472d32ff-4af2-4bfc-94e6-d22f527169f0 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8d8031b9-3e32-452b-8698-9fe52b650d80 req-472d32ff-4af2-4bfc-94e6-d22f527169f0 service nova] Acquiring lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8d8031b9-3e32-452b-8698-9fe52b650d80 req-472d32ff-4af2-4bfc-94e6-d22f527169f0 service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8d8031b9-3e32-452b-8698-9fe52b650d80 req-472d32ff-4af2-4bfc-94e6-d22f527169f0 service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG nova.compute.manager [req-8d8031b9-3e32-452b-8698-9fe52b650d80 req-472d32ff-4af2-4bfc-94e6-d22f527169f0 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] No waiting events found dispatching network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:27:26 user nova-compute[75203]: WARNING nova.compute.manager [req-8d8031b9-3e32-452b-8698-9fe52b650d80 req-472d32ff-4af2-4bfc-94e6-d22f527169f0 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received unexpected event network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 for instance with vm_state building and task_state spawning.
Nov 28 19:27:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:27:28 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Instance spawned successfully.
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:27:28 user nova-compute[75203]: INFO nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-72ed2d5b-1dd7-4de8-a3fb-3005a129de32 req-f45b02e1-b24e-4c80-a259-f19e3eda867f service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-72ed2d5b-1dd7-4de8-a3fb-3005a129de32 req-f45b02e1-b24e-4c80-a259-f19e3eda867f service nova] Acquiring lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-72ed2d5b-1dd7-4de8-a3fb-3005a129de32 req-f45b02e1-b24e-4c80-a259-f19e3eda867f service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-72ed2d5b-1dd7-4de8-a3fb-3005a129de32 req-f45b02e1-b24e-4c80-a259-f19e3eda867f service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:27:28 user nova-compute[75203]: DEBUG nova.compute.manager [req-72ed2d5b-1dd7-4de8-a3fb-3005a129de32 req-f45b02e1-b24e-4c80-a259-f19e3eda867f service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] No waiting events found dispatching network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:27:28 user nova-compute[75203]: WARNING nova.compute.manager [req-72ed2d5b-1dd7-4de8-a3fb-3005a129de32 req-f45b02e1-b24e-4c80-a259-f19e3eda867f service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received unexpected event network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 for instance with vm_state building and task_state spawning.
Nov 28 19:27:28 user nova-compute[75203]: INFO nova.compute.manager [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Took 12.94 seconds to build instance.
Nov 28 19:27:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-fd7ed001-61ec-4eb9-b484-b305502fc55d tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.039s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:27:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:27:32 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:27:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:27:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:27:32 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:27:32 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid afa6449c-33ec-4fda-8680-fd2b07dd8ede {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:27:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating instance_info_cache with network_info: [{"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:27:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:27:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:27:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:27:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:27:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:49 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:27:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:28:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:28:21 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:28:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:28:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:28:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:28:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.90604019165039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance afa6449c-33ec-4fda-8680-fd2b07dd8ede actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:28:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:28:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:28:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:28:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:28:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:28:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:28:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:27 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:28:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:28:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:28:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:28:33 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:28:33 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:28:33 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid afa6449c-33ec-4fda-8680-fd2b07dd8ede {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:28:34 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating instance_info_cache with network_info: [{"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:28:34 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:28:34 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:28:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:28:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:28:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:28:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:28:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:28:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:28:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:28:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:28:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:07 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-changed-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:29:07 user nova-compute[75203]: DEBUG nova.compute.manager [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Refreshing instance network info cache due to event network-changed-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:29:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] Acquiring lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:29:07 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] Acquired lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:29:07 user nova-compute[75203]: DEBUG nova.network.neutron [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Refreshing network info cache for port 7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:29:08 user nova-compute[75203]: DEBUG nova.network.neutron [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updated VIF entry in instance network info cache for port 7b24bb1b-3fd4-4fd0-8d9a-a887231691b7. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:29:08 user nova-compute[75203]: DEBUG nova.network.neutron [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating instance_info_cache with network_info: [{"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:29:08 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-364ecf9c-d017-4eab-b9ed-f574a6264c47 req-c14ad2cf-77c5-4812-b290-243fe76c8040 service nova] Releasing lock "refresh_cache-afa6449c-33ec-4fda-8680-fd2b07dd8ede" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:29:09 user nova-compute[75203]: INFO nova.compute.manager [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Terminating instance
Nov 28 19:29:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-819c2893-bce2-422d-ac81-25c6c908621d req-a53b3ffc-045e-4ac4-8f74-d934318a44d7 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-vif-unplugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-819c2893-bce2-422d-ac81-25c6c908621d req-a53b3ffc-045e-4ac4-8f74-d934318a44d7 service nova] Acquiring lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-819c2893-bce2-422d-ac81-25c6c908621d req-a53b3ffc-045e-4ac4-8f74-d934318a44d7 service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-819c2893-bce2-422d-ac81-25c6c908621d req-a53b3ffc-045e-4ac4-8f74-d934318a44d7 service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-819c2893-bce2-422d-ac81-25c6c908621d req-a53b3ffc-045e-4ac4-8f74-d934318a44d7 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] No waiting events found dispatching network-vif-unplugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.compute.manager [req-819c2893-bce2-422d-ac81-25c6c908621d req-a53b3ffc-045e-4ac4-8f74-d934318a44d7 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-vif-unplugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Instance destroyed successfully.
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.objects.instance [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'resources' on Instance uuid afa6449c-33ec-4fda-8680-fd2b07dd8ede {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1400893156',display_name='tempest-TestVolumeBootPattern-server-1400893156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1400893156',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:27:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-3qmf8cg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:27:29Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=afa6449c-33ec-4fda-8680-fd2b07dd8ede,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "address": "fa:16:3e:5c:ac:37", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b24bb1b-3f", "ovs_interfaceid": "7b24bb1b-3fd4-4fd0-8d9a-a887231691b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ac:37,bridge_name='br-int',has_traffic_filtering=True,id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b24bb1b-3f') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_vif [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ac:37,bridge_name='br-int',has_traffic_filtering=True,id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b24bb1b-3f') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b24bb1b-3f, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab15a819-ed48-4bf0-a933-053dc3099cc0) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:29:10 user nova-compute[75203]: INFO os_vif [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ac:37,bridge_name='br-int',has_traffic_filtering=True,id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b24bb1b-3f')
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:29:10 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b36ef-ec35-49ee-8933-90269c073223]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:29:10 user nova-compute[75203]: No targets found.
Nov 28 19:29:10 user nova-compute[75203]: iSNS:
Nov 28 19:29:10 user nova-compute[75203]: No targets found.
Nov 28 19:29:10 user nova-compute[75203]: STATIC:
Nov 28 19:29:10 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65
Nov 28 19:29:10 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:29:10 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:29:10 user nova-compute[75203]: FIRMWARE:
Nov 28 19:29:10 user nova-compute[75203]: No targets found.
Nov 28 19:29:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:29:10 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:29:10 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[63408479-20cf-4971-9031-9d79b7bce881]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b2366-a8ec-45a2-8de9-891ac42bfe8c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:29:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:29:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0790189120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7861021f-a358-4112-9046-f20b6032e359]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dca117-6005-498c-a90e-33c8049fc642]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd59c9-6274-423d-86d2-ca0176fe26f7]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd083ed1-2c48-4242-893b-c1d37eeb3b5b]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO72210d85-67acfb7f01cfb48c', '/dev/disk/by-id/scsi-23637616366623766', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_72210d85') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd47d72-97a7-42d6-a9a2-56e40ff79997]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1acd1-d195-48f9-9654-c503991313e8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abb96f0-234d-4ca4-999a-dba9738cdaa0]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]
Nov 28 19:29:10 user nova-compute[75203]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.
Nov 28 19:29:10 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc8a0ec-4bf0-40c2-bffd-dcf0a3eaf54d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== disconnect_volume: return (309ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:29:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Deleting instance files /opt/stack/data/nova/instances/afa6449c-33ec-4fda-8680-fd2b07dd8ede_del
Nov 28 19:29:10 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Deletion of /opt/stack/data/nova/instances/afa6449c-33ec-4fda-8680-fd2b07dd8ede_del complete
Nov 28 19:29:10 user nova-compute[75203]: INFO nova.compute.manager [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 28 19:29:10 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:29:10 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:29:11 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:29:11 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Took 0.84 seconds to deallocate network for instance.
Nov 28 19:29:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-ff10b12a-2de6-4e83-9b9f-39f898ba921d req-b81a28e7-b5eb-4b3c-9cae-05917421b670 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-vif-deleted-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:29:11 user nova-compute[75203]: INFO nova.compute.manager [req-ff10b12a-2de6-4e83-9b9f-39f898ba921d req-b81a28e7-b5eb-4b3c-9cae-05917421b670 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Neutron deleted interface 7b24bb1b-3fd4-4fd0-8d9a-a887231691b7; detaching it from the instance and deleting it from the info cache
Nov 28 19:29:11 user nova-compute[75203]: DEBUG nova.network.neutron [req-ff10b12a-2de6-4e83-9b9f-39f898ba921d req-b81a28e7-b5eb-4b3c-9cae-05917421b670 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:29:11 user nova-compute[75203]: DEBUG nova.compute.manager [req-ff10b12a-2de6-4e83-9b9f-39f898ba921d req-b81a28e7-b5eb-4b3c-9cae-05917421b670 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Detach interface failed, port_id=7b24bb1b-3fd4-4fd0-8d9a-a887231691b7, reason: Instance afa6449c-33ec-4fda-8680-fd2b07dd8ede could not be found. {{(pid=75203) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-ca81ec72-2ee4-4754-a4ae-8de28af0a50f req-3414a30e-011e-438a-92af-e2ba3881f068 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received event network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ca81ec72-2ee4-4754-a4ae-8de28af0a50f req-3414a30e-011e-438a-92af-e2ba3881f068 service nova] Acquiring lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ca81ec72-2ee4-4754-a4ae-8de28af0a50f req-3414a30e-011e-438a-92af-e2ba3881f068 service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-ca81ec72-2ee4-4754-a4ae-8de28af0a50f req-3414a30e-011e-438a-92af-e2ba3881f068 service nova] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-ca81ec72-2ee4-4754-a4ae-8de28af0a50f req-3414a30e-011e-438a-92af-e2ba3881f068 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] No waiting events found dispatching network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:29:12 user nova-compute[75203]: WARNING nova.compute.manager [req-ca81ec72-2ee4-4754-a4ae-8de28af0a50f req-3414a30e-011e-438a-92af-e2ba3881f068 service nova] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Received unexpected event network-vif-plugged-7b24bb1b-3fd4-4fd0-8d9a-a887231691b7 for instance with vm_state active and task_state deleting.
Nov 28 19:29:12 user nova-compute[75203]: INFO nova.compute.manager [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: afa6449c-33ec-4fda-8680-fd2b07dd8ede] Took 0.77 seconds to detach 1 volumes for instance.
Nov 28 19:29:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:29:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:29:12 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Deleted allocations for instance afa6449c-33ec-4fda-8680-fd2b07dd8ede
Nov 28 19:29:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-9f96d496-058a-4304-9031-3cb60adc8813 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "afa6449c-33ec-4fda-8680-fd2b07dd8ede" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.237s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:29:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:29:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:29:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:29:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:29:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:29:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:29:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:29:22 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:29:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:29:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:29:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=24.905181884765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:29:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:29:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:24 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:29:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:29:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:29:35 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:29:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:29:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:29:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:29:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:30:01 user nova-compute[75203]: INFO nova.compute.claims [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Claim successful on node user
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:30:01 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:30:01 user nova-compute[75203]: INFO nova.virt.block_device [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Booting with volume 13b35c98-24f4-40d8-a805-2f950c060f65 at /dev/vda
Nov 28 19:30:01 user nova-compute[75203]: DEBUG nova.policy [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c05ab9db4044e19fef91d0cab2ba03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31eb98a16d749d59528a72449f26c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG os_brick.utils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab66ce7-b1f6-4b3a-808e-e704085fcb35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:01 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0819fd0a-d986-4813-91d2-35723d3fc037]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6927a646-cc44-4b60-a3d9-389fbc74f10b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d770440-20b4-46cc-a2c3-5921bf0e7d55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:30:02 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:30:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea1953-9162-4f77-a774-565f8dc30991]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG os_brick.utils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating existing volume attachment record: ed6cbfc9-214f-4a15-a286-3d5785fba5ac {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:30:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Successfully created port: 9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Successfully updated port: 9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-changed-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Refreshing instance network info cache due to event network-changed-9b0cbee1-d5c4-4184-b60b-de639548c134. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Instance network_info: |[{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.network.neutron [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Refreshing network info cache for port 9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.network.neutron [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updated VIF entry in instance network info cache for port 9b0cbee1-d5c4-4184-b60b-de639548c134. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG nova.network.neutron [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:30:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-3649a938-aa29-4c07-aaab-1344e13cec5d req-b1b9098a-e62a-4af7-a7fb-48cde46cb2c0 service nova] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:30:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:30:09 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Creating image(s)
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Ensure instance console log exists: /opt/stack/data/nova/instances/252c4ef2-8ecd-4011-bdb3-16578b7b5594/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Start _get_guest_xml network_info=[{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '252c4ef2-8ecd-4011-bdb3-16578b7b5594', 'attached_at': '', 'detached_at': '', 'volume_id': '13b35c98-24f4-40d8-a805-2f950c060f65', 'serial': '13b35c98-24f4-40d8-a805-2f950c060f65'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'ed6cbfc9-214f-4a15-a286-3d5785fba5ac', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:30:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:30:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:30:09 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:30:09 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:30:09 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c55e96-fa24-4637-a2ad-219df0571e3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:30:09 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d458c7-0451-4f91-913f-fd0f3b8e6762]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65] added
Nov 28 19:30:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee84d1a6-b300-40eb-99a4-a82651fa57c8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cced87-82c1-4c05-954d-2e03a7ca4a01]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHMiknQO {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHMiknQO" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f3e52-570a-4840-907c-a6a977ec6d20]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oHMiknQO'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97b7049-21fa-451c-8bdf-7ea90cb3e100]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b71ae89-6a0c-4249-8f26-71c3facc8b95]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:30:09 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 28 19:30:09 user nova-compute[75203]:  {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:30:09 user nova-compute[75203]: WARNING os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 28 19:30:09 user nova-compute[75203]: 
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2accc62-5454-4653-ae45-f75eb6878d8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]
Nov 28 19:30:09 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.
Nov 28 19:30:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b884981-5d98-4d05-9dd7-714f80d674bd]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b2441b-960a-421c-900c-e1ad636e3120]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:30:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:30:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58fab24-80c1-49ca-899c-9d5e7709c660]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:30:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23637616366623766', 'path': '/dev/sdb'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637616366623766', 'path': '/dev/sdb'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-653914828',display_name='tempest-TestVolumeBootPattern-server-653914828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-653914828',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-yxmai7kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:30:02Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=252c4ef2-8ecd-4011-bdb3-16578b7b5594,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:68,bridge_name='br-int',has_traffic_filtering=True,id=9b0cbee1-d5c4-4184-b60b-de639548c134,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0cbee1-d5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.objects.instance [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'pci_devices' on Instance uuid 252c4ef2-8ecd-4011-bdb3-16578b7b5594 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:30:10 user nova-compute[75203]:   <uuid>252c4ef2-8ecd-4011-bdb3-16578b7b5594</uuid>
Nov 28 19:30:10 user nova-compute[75203]:   <name>instance-00000033</name>
Nov 28 19:30:10 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:30:10 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:30:10 user nova-compute[75203]:   <metadata>
Nov 28 19:30:10 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:30:10 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:30:10 user nova-compute[75203]:       <nova:name>tempest-TestVolumeBootPattern-server-653914828</nova:name>
Nov 28 19:30:10 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:30:09</nova:creationTime>
Nov 28 19:30:10 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:30:10 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:30:10 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:30:10 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:30:10 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:30:10 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:30:10 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:30:10 user nova-compute[75203]:       <nova:owner>
Nov 28 19:30:10 user nova-compute[75203]:         <nova:user uuid="a2c05ab9db4044e19fef91d0cab2ba03">tempest-TestVolumeBootPattern-1643995956-project-member</nova:user>
Nov 28 19:30:10 user nova-compute[75203]:         <nova:project uuid="e31eb98a16d749d59528a72449f26c46">tempest-TestVolumeBootPattern-1643995956</nova:project>
Nov 28 19:30:10 user nova-compute[75203]:       </nova:owner>
Nov 28 19:30:10 user nova-compute[75203]:       <nova:ports>
Nov 28 19:30:10 user nova-compute[75203]:         <nova:port uuid="9b0cbee1-d5c4-4184-b60b-de639548c134">
Nov 28 19:30:10 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 28 19:30:10 user nova-compute[75203]:         </nova:port>
Nov 28 19:30:10 user nova-compute[75203]:       </nova:ports>
Nov 28 19:30:10 user nova-compute[75203]:     </nova:instance>
Nov 28 19:30:10 user nova-compute[75203]:   </metadata>
Nov 28 19:30:10 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:30:10 user nova-compute[75203]:     <system>
Nov 28 19:30:10 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:30:10 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:30:10 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:30:10 user nova-compute[75203]:       <entry name="serial">252c4ef2-8ecd-4011-bdb3-16578b7b5594</entry>
Nov 28 19:30:10 user nova-compute[75203]:       <entry name="uuid">252c4ef2-8ecd-4011-bdb3-16578b7b5594</entry>
Nov 28 19:30:10 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:30:10 user nova-compute[75203]:     </system>
Nov 28 19:30:10 user nova-compute[75203]:   </sysinfo>
Nov 28 19:30:10 user nova-compute[75203]:   <os>
Nov 28 19:30:10 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:30:10 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:30:10 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:30:10 user nova-compute[75203]:   </os>
Nov 28 19:30:10 user nova-compute[75203]:   <features>
Nov 28 19:30:10 user nova-compute[75203]:     <acpi/>
Nov 28 19:30:10 user nova-compute[75203]:     <apic/>
Nov 28 19:30:10 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:30:10 user nova-compute[75203]:   </features>
Nov 28 19:30:10 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:30:10 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:30:10 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:30:10 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:30:10 user nova-compute[75203]:   </clock>
Nov 28 19:30:10 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:30:10 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:30:10 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:30:10 user nova-compute[75203]:   </cpu>
Nov 28 19:30:10 user nova-compute[75203]:   <devices>
Nov 28 19:30:10 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:30:10 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:30:10 user nova-compute[75203]:       <source dev="/dev/sdb"/>
Nov 28 19:30:10 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:30:10 user nova-compute[75203]:       <serial>13b35c98-24f4-40d8-a805-2f950c060f65</serial>
Nov 28 19:30:10 user nova-compute[75203]:     </disk>
Nov 28 19:30:10 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:30:10 user nova-compute[75203]:       <mac address="fa:16:3e:60:a6:68"/>
Nov 28 19:30:10 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:30:10 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:30:10 user nova-compute[75203]:       <target dev="tap9b0cbee1-d5"/>
Nov 28 19:30:10 user nova-compute[75203]:     </interface>
Nov 28 19:30:10 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:30:10 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/252c4ef2-8ecd-4011-bdb3-16578b7b5594/console.log" append="off"/>
Nov 28 19:30:10 user nova-compute[75203]:     </serial>
Nov 28 19:30:10 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:30:10 user nova-compute[75203]:     <video>
Nov 28 19:30:10 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:30:10 user nova-compute[75203]:     </video>
Nov 28 19:30:10 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:30:10 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:30:10 user nova-compute[75203]:     </rng>
Nov 28 19:30:10 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:30:10 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:30:10 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:30:10 user nova-compute[75203]:     </memballoon>
Nov 28 19:30:10 user nova-compute[75203]:   </devices>
Nov 28 19:30:10 user nova-compute[75203]: </domain>
Nov 28 19:30:10 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-653914828',display_name='tempest-TestVolumeBootPattern-server-653914828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-653914828',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-yxmai7kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:30:02Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=252c4ef2-8ecd-4011-bdb3-16578b7b5594,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:68,bridge_name='br-int',has_traffic_filtering=True,id=9b0cbee1-d5c4-4184-b60b-de639548c134,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0cbee1-d5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG os_vif [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:68,bridge_name='br-int',has_traffic_filtering=True,id=9b0cbee1-d5c4-4184-b60b-de639548c134,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0cbee1-d5') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce738b8b-6666-56d2-af99-08be0a6f3f7c', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b0cbee1-d5, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b0cbee1-d5, col_values=(('qos', UUID('73e4f4f3-19ca-4384-bde3-08c07a054884')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b0cbee1-d5, col_values=(('external_ids', {'iface-id': '9b0cbee1-d5c4-4184-b60b-de639548c134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:a6:68', 'vm-uuid': '252c4ef2-8ecd-4011-bdb3-16578b7b5594'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:10 user nova-compute[75203]: INFO os_vif [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a6:68,bridge_name='br-int',has_traffic_filtering=True,id=9b0cbee1-d5c4-4184-b60b-de639548c134,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0cbee1-d5')
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:30:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No VIF found with MAC fa:16:3e:60:a6:68, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:30:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-eb20fe6a-204f-4ce3-accd-6cd19334b3df req-3625cafa-463f-45f0-a754-ba1461aa14bc service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-eb20fe6a-204f-4ce3-accd-6cd19334b3df req-3625cafa-463f-45f0-a754-ba1461aa14bc service nova] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-eb20fe6a-204f-4ce3-accd-6cd19334b3df req-3625cafa-463f-45f0-a754-ba1461aa14bc service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-eb20fe6a-204f-4ce3-accd-6cd19334b3df req-3625cafa-463f-45f0-a754-ba1461aa14bc service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-eb20fe6a-204f-4ce3-accd-6cd19334b3df req-3625cafa-463f-45f0-a754-ba1461aa14bc service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] No waiting events found dispatching network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:30:12 user nova-compute[75203]: WARNING nova.compute.manager [req-eb20fe6a-204f-4ce3-accd-6cd19334b3df req-3625cafa-463f-45f0-a754-ba1461aa14bc service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received unexpected event network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 for instance with vm_state building and task_state spawning.
Nov 28 19:30:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:30:13 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Instance spawned successfully.
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:30:13 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:30:14 user nova-compute[75203]: INFO nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 28 19:30:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:30:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-4f6b5764-d94b-4432-91d9-3a246eaa91a9 req-3805784a-b900-43ab-a8e1-4062b7b99ee1 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:30:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4f6b5764-d94b-4432-91d9-3a246eaa91a9 req-3805784a-b900-43ab-a8e1-4062b7b99ee1 service nova] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:30:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4f6b5764-d94b-4432-91d9-3a246eaa91a9 req-3805784a-b900-43ab-a8e1-4062b7b99ee1 service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:30:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-4f6b5764-d94b-4432-91d9-3a246eaa91a9 req-3805784a-b900-43ab-a8e1-4062b7b99ee1 service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:30:14 user nova-compute[75203]: DEBUG nova.compute.manager [req-4f6b5764-d94b-4432-91d9-3a246eaa91a9 req-3805784a-b900-43ab-a8e1-4062b7b99ee1 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] No waiting events found dispatching network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:30:14 user nova-compute[75203]: WARNING nova.compute.manager [req-4f6b5764-d94b-4432-91d9-3a246eaa91a9 req-3805784a-b900-43ab-a8e1-4062b7b99ee1 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received unexpected event network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 for instance with vm_state building and task_state spawning.
Nov 28 19:30:14 user nova-compute[75203]: INFO nova.compute.manager [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Took 12.58 seconds to build instance.
Nov 28 19:30:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-ff18d0e9-b90e-4f72-a8e5-626b2f3fde6b tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.676s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:30:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:30:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:30:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:30:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:30:22 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:30:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:30:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:30:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:30:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.90359878540039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 252c4ef2-8ecd-4011-bdb3-16578b7b5594 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:30:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:30:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:30:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:26 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:30:28 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:30:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:30:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:30:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:30:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:30:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:30:37 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 252c4ef2-8ecd-4011-bdb3-16578b7b5594 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:30:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:30:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:30:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:30:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:30:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:30:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:30:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:30:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:30:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:31:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:31:15 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:31:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:31:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:22 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:31:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:31:22 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:31:22 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:31:22 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:31:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:31:23 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9016MB free_disk=24.902950286865234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 252c4ef2-8ecd-4011-bdb3-16578b7b5594 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:31:23 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:25 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:28 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:28 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:31:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:31:37 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:31:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:31:37 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:31:37 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:31:37 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 252c4ef2-8ecd-4011-bdb3-16578b7b5594 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:31:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:31:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:31:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:31:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:31:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:31:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:31:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-changed-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Refreshing instance network info cache due to event network-changed-9b0cbee1-d5c4-4184-b60b-de639548c134. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Refreshing network info cache for port 9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updated VIF entry in instance network info cache for port 9b0cbee1-d5c4-4184-b60b-de639548c134. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:31:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-06775fb4-7336-4f74-a544-a815a811f1a6 req-0159af1d-a7e6-413f-9402-e7549452c8a3 service nova] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:31:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:54 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:31:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:31:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:31:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "591fe66a-b932-4981-95f7-27cf063466c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:01 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Starting instance... {{(pid=75203) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 28 19:32:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:01 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:01 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75203) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 28 19:32:01 user nova-compute[75203]: INFO nova.compute.claims [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Claim successful on node user
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Start building networks asynchronously for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Allocating IP information in the background. {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.network.neutron [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] allocate_for_instance() {{(pid=75203) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 28 19:32:02 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Start building block device mappings for instance. {{(pid=75203) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.policy [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c05ab9db4044e19fef91d0cab2ba03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31eb98a16d749d59528a72449f26c46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75203) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 28 19:32:02 user nova-compute[75203]: INFO nova.virt.block_device [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Booting with volume 612d025f-1d8c-4fdf-88e2-4819387eb987 at /dev/vda
Nov 28 19:32:02 user nova-compute[75203]: DEBUG os_brick.utils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a85f3e-f8e8-4d15-8923-bff7eb4624b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d0945aea8995\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d665d-8b95-4ec3-8ca5-6793b2a87e67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eba1c7-651a-4a5d-9383-cf8cd4742546]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b55d9e-a701-4102-a397-01f0ec956a8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Running cmd (subprocess): nvme version {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] 'nvme version' failed. Not Retrying. {{(pid=75203) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] nvme not present on system {{(pid=75203) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 28 19:32:02 user nova-compute[75203]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 28 19:32:02 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca0244a-fb07-49f6-b549-72c58b9bc59e]: (4, '') {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75203) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.lightos [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] LIGHTOS: no hostnqn found. {{(pid=75203) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG os_brick.utils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d0945aea8995', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:32:02 user nova-compute[75203]: DEBUG nova.virt.block_device [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updating existing volume attachment record: f776b846-028d-4d23-9348-eed634600671 {{(pid=75203) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Successfully created port: 294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Successfully updated port: 294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquired lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Building network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-changed-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.compute.manager [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Refreshing instance network info cache due to event network-changed-294c0170-7377-47a1-94a7-9605ffd12773. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] Acquiring lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Instance cache missing network info. {{(pid=75203) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.network.neutron [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updating instance_info_cache with network_info: [{"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Releasing lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Instance network_info: |[{"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75203) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] Acquired lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:32:03 user nova-compute[75203]: DEBUG nova.network.neutron [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Refreshing network info cache for port 294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:32:04 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updated VIF entry in instance network info cache for port 294c0170-7377-47a1-94a7-9605ffd12773. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:32:04 user nova-compute[75203]: DEBUG nova.network.neutron [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updating instance_info_cache with network_info: [{"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:32:04 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-fb0f6d50-3bbf-42b9-b115-3e7ea8268801 req-b5c751c2-e3c8-47ba-9d79-733cbcbe3ad8 service nova] Releasing lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:32:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Start spawning the instance on the hypervisor. {{(pid=75203) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Creating instance directory {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 28 19:32:09 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Creating image(s)
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Did not create local disks {{(pid=75203) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Ensure instance console log exists: /opt/stack/data/nova/instances/591fe66a-b932-4981-95f7-27cf063466c5/console.log {{(pid=75203) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Start _get_guest_xml network_info=[{"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKXDnwMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '591fe66a-b932-4981-95f7-27cf063466c5', 'attached_at': '', 'detached_at': '', 'volume_id': '612d025f-1d8c-4fdf-88e2-4819387eb987', 'serial': '612d025f-1d8c-4fdf-88e2-4819387eb987'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'f776b846-028d-4d23-9348-eed634600671', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 28 19:32:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:32:09 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller missing on host. {{(pid=75203) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.host [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU controller found on host. {{(pid=75203) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75203) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-28T18:30:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image limits 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flavor pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Image pref 0:0:0 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75203) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Got 1 possible topologies {{(pid=75203) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.hardware [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75203) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Calling os-brick to attach iSCSI Volume {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKXDnwMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:32:09 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:32:09 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:32:09 user nova-compute[75203]: INFO os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e85860-4f18-4ab3-bb84-c7bc18ed2dac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 28 19:32:09 user nova-compute[75203]:  {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --interface default --op new {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[d193a95e-9037-4f13-b9e5-d461dc0482ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987] added\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987] added
Nov 28 19:32:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.065s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7edd03b-b701-4b53-9797-e6189e0c1f3a]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fada4411-426a-4da8-9c1c-76bb2918941c]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKXDnwMN {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKXDnwMN" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf23af9-04cd-4768-9910-19d8c5ee1359]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKXDnwMN'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e7032-1a7a-4c90-810e-938a4ba9df4d]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f30940e-e093-4fc5-82b7-ff36ba0facc3]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:32:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:32:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --login {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6b5d65-d881-4190-9dc7-82bb8ce84e0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260]
Nov 28 19:32:09 user nova-compute[75203]: Login to [iface: default, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260] successful.
Nov 28 19:32:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a2cfb9-ff83-4905-be16-d9a879449337]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3c7f4d-92df-4531-81ad-dbead9f77062]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:32:09 user nova-compute[75203]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 (non-flash)
Nov 28 19:32:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:32:09 user nova-compute[75203]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 (non-flash)
Nov 28 19:32:09 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to 172.16.0.220:3260 {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75203) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75203) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5477daa2-7adc-44e0-bcdd-bdffd732b828]: (4, ('- - 0', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:32:09 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75203) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKXDnwMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75203) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23061373064623732', 'path': '/dev/sdc'} {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061373064623732', 'path': '/dev/sdc'} {{(pid=75203) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-252197362',display_name='tempest-TestVolumeBootPattern-server-252197362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-252197362',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-y90ng071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:32:02Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=591fe66a-b932-4981-95f7-27cf063466c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75203) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=294c0170-7377-47a1-94a7-9605ffd12773,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294c0170-73') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:32:10 user nova-compute[75203]: DEBUG nova.objects.instance [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'pci_devices' on Instance uuid 591fe66a-b932-4981-95f7-27cf063466c5 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] End _get_guest_xml xml=<domain type="kvm">
Nov 28 19:32:11 user nova-compute[75203]:   <uuid>591fe66a-b932-4981-95f7-27cf063466c5</uuid>
Nov 28 19:32:11 user nova-compute[75203]:   <name>instance-00000034</name>
Nov 28 19:32:11 user nova-compute[75203]:   <memory>524288</memory>
Nov 28 19:32:11 user nova-compute[75203]:   <vcpu>1</vcpu>
Nov 28 19:32:11 user nova-compute[75203]:   <metadata>
Nov 28 19:32:11 user nova-compute[75203]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 28 19:32:11 user nova-compute[75203]:       <nova:package version="0.0.0"/>
Nov 28 19:32:11 user nova-compute[75203]:       <nova:name>tempest-TestVolumeBootPattern-server-252197362</nova:name>
Nov 28 19:32:11 user nova-compute[75203]:       <nova:creationTime>2023-11-28 19:32:09</nova:creationTime>
Nov 28 19:32:11 user nova-compute[75203]:       <nova:flavor name="m1.tiny">
Nov 28 19:32:11 user nova-compute[75203]:         <nova:memory>512</nova:memory>
Nov 28 19:32:11 user nova-compute[75203]:         <nova:disk>1</nova:disk>
Nov 28 19:32:11 user nova-compute[75203]:         <nova:swap>0</nova:swap>
Nov 28 19:32:11 user nova-compute[75203]:         <nova:ephemeral>0</nova:ephemeral>
Nov 28 19:32:11 user nova-compute[75203]:         <nova:vcpus>1</nova:vcpus>
Nov 28 19:32:11 user nova-compute[75203]:       </nova:flavor>
Nov 28 19:32:11 user nova-compute[75203]:       <nova:owner>
Nov 28 19:32:11 user nova-compute[75203]:         <nova:user uuid="a2c05ab9db4044e19fef91d0cab2ba03">tempest-TestVolumeBootPattern-1643995956-project-member</nova:user>
Nov 28 19:32:11 user nova-compute[75203]:         <nova:project uuid="e31eb98a16d749d59528a72449f26c46">tempest-TestVolumeBootPattern-1643995956</nova:project>
Nov 28 19:32:11 user nova-compute[75203]:       </nova:owner>
Nov 28 19:32:11 user nova-compute[75203]:       <nova:ports>
Nov 28 19:32:11 user nova-compute[75203]:         <nova:port uuid="294c0170-7377-47a1-94a7-9605ffd12773">
Nov 28 19:32:11 user nova-compute[75203]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 28 19:32:11 user nova-compute[75203]:         </nova:port>
Nov 28 19:32:11 user nova-compute[75203]:       </nova:ports>
Nov 28 19:32:11 user nova-compute[75203]:     </nova:instance>
Nov 28 19:32:11 user nova-compute[75203]:   </metadata>
Nov 28 19:32:11 user nova-compute[75203]:   <sysinfo type="smbios">
Nov 28 19:32:11 user nova-compute[75203]:     <system>
Nov 28 19:32:11 user nova-compute[75203]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 28 19:32:11 user nova-compute[75203]:       <entry name="product">OpenStack Nova</entry>
Nov 28 19:32:11 user nova-compute[75203]:       <entry name="version">0.0.0</entry>
Nov 28 19:32:11 user nova-compute[75203]:       <entry name="serial">591fe66a-b932-4981-95f7-27cf063466c5</entry>
Nov 28 19:32:11 user nova-compute[75203]:       <entry name="uuid">591fe66a-b932-4981-95f7-27cf063466c5</entry>
Nov 28 19:32:11 user nova-compute[75203]:       <entry name="family">Virtual Machine</entry>
Nov 28 19:32:11 user nova-compute[75203]:     </system>
Nov 28 19:32:11 user nova-compute[75203]:   </sysinfo>
Nov 28 19:32:11 user nova-compute[75203]:   <os>
Nov 28 19:32:11 user nova-compute[75203]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 28 19:32:11 user nova-compute[75203]:     <boot dev="hd"/>
Nov 28 19:32:11 user nova-compute[75203]:     <smbios mode="sysinfo"/>
Nov 28 19:32:11 user nova-compute[75203]:   </os>
Nov 28 19:32:11 user nova-compute[75203]:   <features>
Nov 28 19:32:11 user nova-compute[75203]:     <acpi/>
Nov 28 19:32:11 user nova-compute[75203]:     <apic/>
Nov 28 19:32:11 user nova-compute[75203]:     <vmcoreinfo/>
Nov 28 19:32:11 user nova-compute[75203]:   </features>
Nov 28 19:32:11 user nova-compute[75203]:   <clock offset="utc">
Nov 28 19:32:11 user nova-compute[75203]:     <timer name="pit" tickpolicy="delay"/>
Nov 28 19:32:11 user nova-compute[75203]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 28 19:32:11 user nova-compute[75203]:     <timer name="hpet" present="no"/>
Nov 28 19:32:11 user nova-compute[75203]:   </clock>
Nov 28 19:32:11 user nova-compute[75203]:   <cpu mode="custom" match="exact">
Nov 28 19:32:11 user nova-compute[75203]:     <model>Nehalem</model>
Nov 28 19:32:11 user nova-compute[75203]:     <topology sockets="1" cores="1" threads="1"/>
Nov 28 19:32:11 user nova-compute[75203]:   </cpu>
Nov 28 19:32:11 user nova-compute[75203]:   <devices>
Nov 28 19:32:11 user nova-compute[75203]:     <disk type="block" device="disk">
Nov 28 19:32:11 user nova-compute[75203]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 28 19:32:11 user nova-compute[75203]:       <source dev="/dev/sdc"/>
Nov 28 19:32:11 user nova-compute[75203]:       <target dev="vda" bus="virtio"/>
Nov 28 19:32:11 user nova-compute[75203]:       <serial>612d025f-1d8c-4fdf-88e2-4819387eb987</serial>
Nov 28 19:32:11 user nova-compute[75203]:     </disk>
Nov 28 19:32:11 user nova-compute[75203]:     <interface type="ethernet">
Nov 28 19:32:11 user nova-compute[75203]:       <mac address="fa:16:3e:9b:38:d6"/>
Nov 28 19:32:11 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:32:11 user nova-compute[75203]:       <mtu size="1442"/>
Nov 28 19:32:11 user nova-compute[75203]:       <target dev="tap294c0170-73"/>
Nov 28 19:32:11 user nova-compute[75203]:     </interface>
Nov 28 19:32:11 user nova-compute[75203]:     <serial type="pty">
Nov 28 19:32:11 user nova-compute[75203]:       <log file="/opt/stack/data/nova/instances/591fe66a-b932-4981-95f7-27cf063466c5/console.log" append="off"/>
Nov 28 19:32:11 user nova-compute[75203]:     </serial>
Nov 28 19:32:11 user nova-compute[75203]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 28 19:32:11 user nova-compute[75203]:     <video>
Nov 28 19:32:11 user nova-compute[75203]:       <model type="virtio"/>
Nov 28 19:32:11 user nova-compute[75203]:     </video>
Nov 28 19:32:11 user nova-compute[75203]:     <rng model="virtio">
Nov 28 19:32:11 user nova-compute[75203]:       <backend model="random">/dev/urandom</backend>
Nov 28 19:32:11 user nova-compute[75203]:     </rng>
Nov 28 19:32:11 user nova-compute[75203]:     <controller type="usb" index="0" model="none"/>
Nov 28 19:32:11 user nova-compute[75203]:     <memballoon model="virtio">
Nov 28 19:32:11 user nova-compute[75203]:       <stats period="10"/>
Nov 28 19:32:11 user nova-compute[75203]:     </memballoon>
Nov 28 19:32:11 user nova-compute[75203]:   </devices>
Nov 28 19:32:11 user nova-compute[75203]: </domain>
Nov 28 19:32:11 user nova-compute[75203]:  {{(pid=75203) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-252197362',display_name='tempest-TestVolumeBootPattern-server-252197362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-252197362',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-y90ng071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-28T19:32:02Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=591fe66a-b932-4981-95f7-27cf063466c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=294c0170-7377-47a1-94a7-9605ffd12773,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294c0170-73') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG os_vif [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=294c0170-7377-47a1-94a7-9605ffd12773,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294c0170-73') {{(pid=75203) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0495f6ea-2b54-55dc-bef9-5079056a6397', '_type': 'linux-noop'}}, row=False) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap294c0170-73, may_exist=True, interface_attrs={}) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap294c0170-73, col_values=(('qos', UUID('b2ddbbfe-0a2e-4da0-9db9-2c50b76311a4')),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap294c0170-73, col_values=(('external_ids', {'iface-id': '294c0170-7377-47a1-94a7-9605ffd12773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:38:d6', 'vm-uuid': '591fe66a-b932-4981-95f7-27cf063466c5'}),), if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:11 user nova-compute[75203]: INFO os_vif [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=294c0170-7377-47a1-94a7-9605ffd12773,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294c0170-73')
Nov 28 19:32:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No BDM found with device name vda, not building metadata. {{(pid=75203) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 28 19:32:11 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] No VIF found with MAC fa:16:3e:9b:38:d6, not building metadata {{(pid=75203) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-b1f3edb5-40bb-48da-a637-5b810a8ece77 req-8a18b613-076d-45d5-85a1-98f087473754 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b1f3edb5-40bb-48da-a637-5b810a8ece77 req-8a18b613-076d-45d5-85a1-98f087473754 service nova] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b1f3edb5-40bb-48da-a637-5b810a8ece77 req-8a18b613-076d-45d5-85a1-98f087473754 service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-b1f3edb5-40bb-48da-a637-5b810a8ece77 req-8a18b613-076d-45d5-85a1-98f087473754 service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:12 user nova-compute[75203]: DEBUG nova.compute.manager [req-b1f3edb5-40bb-48da-a637-5b810a8ece77 req-8a18b613-076d-45d5-85a1-98f087473754 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] No waiting events found dispatching network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:32:12 user nova-compute[75203]: WARNING nova.compute.manager [req-b1f3edb5-40bb-48da-a637-5b810a8ece77 req-8a18b613-076d-45d5-85a1-98f087473754 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received unexpected event network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 for instance with vm_state building and task_state spawning.
Nov 28 19:32:13 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Instance event wait completed in 0 seconds for  {{(pid=75203) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Guest created on hypervisor {{(pid=75203) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 28 19:32:14 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Instance spawned successfully.
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Found default for hw_cdrom_bus of ide {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Found default for hw_disk_bus of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Found default for hw_input_bus of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Found default for hw_pointer_model of None {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Found default for hw_video_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Found default for hw_vif_model of virtio {{(pid=75203) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 28 19:32:14 user nova-compute[75203]: INFO nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 28 19:32:14 user nova-compute[75203]: DEBUG nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Checking state {{(pid=75203) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 28 19:32:14 user nova-compute[75203]: INFO nova.compute.manager [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Took 12.71 seconds to build instance.
Nov 28 19:32:14 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-36557353-6411-49e5-94f1-af881860f535 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "591fe66a-b932-4981-95f7-27cf063466c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.792s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:14 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-41eb8e4b-87cf-4b2d-91bd-910eb6df42e9 req-2715878b-a057-4915-ad89-bb6e3cb5ba5b service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:32:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-41eb8e4b-87cf-4b2d-91bd-910eb6df42e9 req-2715878b-a057-4915-ad89-bb6e3cb5ba5b service nova] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-41eb8e4b-87cf-4b2d-91bd-910eb6df42e9 req-2715878b-a057-4915-ad89-bb6e3cb5ba5b service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:15 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-41eb8e4b-87cf-4b2d-91bd-910eb6df42e9 req-2715878b-a057-4915-ad89-bb6e3cb5ba5b service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:15 user nova-compute[75203]: DEBUG nova.compute.manager [req-41eb8e4b-87cf-4b2d-91bd-910eb6df42e9 req-2715878b-a057-4915-ad89-bb6e3cb5ba5b service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] No waiting events found dispatching network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:32:15 user nova-compute[75203]: WARNING nova.compute.manager [req-41eb8e4b-87cf-4b2d-91bd-910eb6df42e9 req-2715878b-a057-4915-ad89-bb6e3cb5ba5b service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received unexpected event network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 for instance with vm_state active and task_state None.
Nov 28 19:32:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_power_states {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 252c4ef2-8ecd-4011-bdb3-16578b7b5594 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Triggering sync for uuid 591fe66a-b932-4981-95f7-27cf063466c5 {{(pid=75203) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "591fe66a-b932-4981-95f7-27cf063466c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:21 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "591fe66a-b932-4981-95f7-27cf063466c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:32:24 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:32:25 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:32:25 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=24.901126861572266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 252c4ef2-8ecd-4011-bdb3-16578b7b5594 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 591fe66a-b932-4981-95f7-27cf063466c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:32:25 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:32:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:28 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:29 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:30 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:32:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:34 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:32:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:32:38 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:32:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:32:38 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:32:38 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:32:38 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 252c4ef2-8ecd-4011-bdb3-16578b7b5594 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:32:39 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:39 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:32:39 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:32:39 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:32:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:44 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:32:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:32:56 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:33:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:33:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:33:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:33:01 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:06 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:11 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:16 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:21 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:25 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:33:26 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:33:27 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:33:27 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=24.892677307128906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 252c4ef2-8ecd-4011-bdb3-16578b7b5594 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 591fe66a-b932-4981-95f7-27cf063466c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:33:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:33:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:30 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:33:31 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:33:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:32 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:36 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:33:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:37 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:40 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:33:40 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updating instance_info_cache with network_info: [{"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:33:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:33:46 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:51 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:33:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-changed-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:33:53 user nova-compute[75203]: DEBUG nova.compute.manager [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Refreshing instance network info cache due to event network-changed-294c0170-7377-47a1-94a7-9605ffd12773. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:33:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] Acquiring lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:33:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] Acquired lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:33:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Refreshing network info cache for port 294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updated VIF entry in instance network info cache for port 294c0170-7377-47a1-94a7-9605ffd12773. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updating instance_info_cache with network_info: [{"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-20d40b0f-b015-4fa6-ae10-6be1b2da079f req-5a02f163-a738-4683-bbc9-d37ee7e1373d service nova] Releasing lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-changed-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Refreshing instance network info cache due to event network-changed-294c0170-7377-47a1-94a7-9605ffd12773. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] Acquiring lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] Acquired lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG nova.network.neutron [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Refreshing network info cache for port 294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "591fe66a-b932-4981-95f7-27cf063466c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:33:54 user nova-compute[75203]: INFO nova.compute.manager [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Terminating instance
Nov 28 19:33:54 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:33:54 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Instance destroyed successfully.
Nov 28 19:33:55 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'resources' on Instance uuid 591fe66a-b932-4981-95f7-27cf063466c5 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-252197362',display_name='tempest-TestVolumeBootPattern-server-252197362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-252197362',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-y90ng071',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:32:15Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=591fe66a-b932-4981-95f7-27cf063466c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=294c0170-7377-47a1-94a7-9605ffd12773,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294c0170-73') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_vif [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=294c0170-7377-47a1-94a7-9605ffd12773,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294c0170-73') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap294c0170-73, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2ddbbfe-0a2e-4da0-9db9-2c50b76311a4) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:33:55 user nova-compute[75203]: INFO os_vif [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:38:d6,bridge_name='br-int',has_traffic_filtering=True,id=294c0170-7377-47a1-94a7-9605ffd12773,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294c0170-73')
Nov 28 19:33:55 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKXDnwMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:33:55 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG nova.network.neutron [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updated VIF entry in instance network info cache for port 294c0170-7377-47a1-94a7-9605ffd12773. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG nova.network.neutron [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updating instance_info_cache with network_info: [{"id": "294c0170-7377-47a1-94a7-9605ffd12773", "address": "fa:16:3e:9b:38:d6", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294c0170-73", "ovs_interfaceid": "294c0170-7377-47a1-94a7-9605ffd12773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-8fb92a72-3dff-4c4e-978c-766c829c9f9d req-6bfb1aee-7ea2-4a25-8cbe-55faaba1bcb5 service nova] Releasing lock "refresh_cache-591fe66a-b932-4981-95f7-27cf063466c5" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b1f53f-99ac-46ab-ba88-927f266a3f1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:33:55 user nova-compute[75203]: No targets found.
Nov 28 19:33:55 user nova-compute[75203]: iSNS:
Nov 28 19:33:55 user nova-compute[75203]: No targets found.
Nov 28 19:33:55 user nova-compute[75203]: STATIC:
Nov 28 19:33:55 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65
Nov 28 19:33:55 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:33:55 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:33:55 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987
Nov 28 19:33:55 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:33:55 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:33:55 user nova-compute[75203]: FIRMWARE:
Nov 28 19:33:55 user nova-compute[75203]: No targets found.
Nov 28 19:33:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:33:55 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:33:55 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c294483-faff-4b23-b611-f0c0d6efa581]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ff6047-af27-463f-b80d-7ae9b3d24f6c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:33:55 user nova-compute[75203]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 (non-flash)
Nov 28 19:33:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:33:55 user nova-compute[75203]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 (non-flash)
Nov 28 19:33:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f079026a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987'): ({'sdc'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Removing single pathed devices sdc {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f43216-bcff-4e80-a5a0-784c6648c0e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f6aed-a9a6-4f54-b538-17b5547ea2f8]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flushing IO for device /dev/sdc {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a68b93-f68b-44e3-abf6-55512a339a52]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3166308-8ff9-4e80-b4a8-6f5ec34982dc]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] SCSI volumes sdc have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e3bfb-1b29-4189-b261-ffe8b2933539]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d4a9e6-ce1d-474a-baf4-b119dc888964]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260]
Nov 28 19:33:55 user nova-compute[75203]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987, portal: 172.16.0.220,3260] successful.
Nov 28 19:33:55 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:33:55 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-vif-unplugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] No waiting events found dispatching network-vif-unplugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-vif-unplugged-294c0170-7377-47a1-94a7-9605ffd12773 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] Acquiring lock "591fe66a-b932-4981-95f7-27cf063466c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] Lock "591fe66a-b932-4981-95f7-27cf063466c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] No waiting events found dispatching network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:33:56 user nova-compute[75203]: WARNING nova.compute.manager [req-920b4b83-2ac0-4e99-b230-b0ed8489bd0d req-239a6488-f202-4b83-b6b2-1bb0b07de34a service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received unexpected event network-vif-plugged-294c0170-7377-47a1-94a7-9605ffd12773 for instance with vm_state active and task_state deleting.
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:612d025f-1d8c-4fdf-88e2-4819387eb987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.084s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb159a-3e6f-4109-a18d-983a7897c6e8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== disconnect_volume: return (372ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:33:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Deleting instance files /opt/stack/data/nova/instances/591fe66a-b932-4981-95f7-27cf063466c5_del
Nov 28 19:33:56 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Deletion of /opt/stack/data/nova/instances/591fe66a-b932-4981-95f7-27cf063466c5_del complete
Nov 28 19:33:56 user nova-compute[75203]: INFO nova.compute.manager [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 28 19:33:56 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:33:56 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Took 0.42 seconds to deallocate network for instance.
Nov 28 19:33:56 user nova-compute[75203]: DEBUG nova.compute.manager [req-b70b979f-26cf-4ab2-b5ad-2f744eb3fb6d req-b327e5f1-887b-430f-8c3e-da71e8ba2ea1 service nova] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Received event network-vif-deleted-294c0170-7377-47a1-94a7-9605ffd12773 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:33:57 user nova-compute[75203]: INFO nova.compute.manager [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 591fe66a-b932-4981-95f7-27cf063466c5] Took 0.79 seconds to detach 1 volumes for instance.
Nov 28 19:33:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:33:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:33:57 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:33:57 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:33:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:33:57 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Deleted allocations for instance 591fe66a-b932-4981-95f7-27cf063466c5
Nov 28 19:33:57 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1701edd7-bc5b-4839-b0c9-99bae6b0a3ee tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "591fe66a-b932-4981-95f7-27cf063466c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.834s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:33:59 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:00 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:05 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:10 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:15 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:20 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:25 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:25 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:27 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:34:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:34:27 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:34:27 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:34:27 user nova-compute[75203]: DEBUG nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75203) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 28 19:34:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:34:28 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:34:28 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=24.89177703857422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Instance 252c4ef2-8ecd-4011-bdb3-16578b7b5594 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75203) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:34:28 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:34:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:30 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:34:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:35 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:40 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:34:41 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:34:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:34:41 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:34:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:34:41 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:34:41 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Forcefully refreshing network info cache for instance {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 28 19:34:41 user nova-compute[75203]: DEBUG nova.objects.instance [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lazy-loading 'info_cache' on Instance uuid 252c4ef2-8ecd-4011-bdb3-16578b7b5594 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:34:42 user nova-compute[75203]: DEBUG nova.network.neutron [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:34:42 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:34:42 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updated the network info_cache for instance {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 28 19:34:45 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:34:50 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-changed-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG nova.compute.manager [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Refreshing instance network info cache due to event network-changed-9b0cbee1-d5c4-4184-b60b-de639548c134. {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] Acquiring lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] Acquired lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Refreshing network info cache for port 9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:34:52 user nova-compute[75203]: INFO nova.compute.manager [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Terminating instance
Nov 28 19:34:52 user nova-compute[75203]: DEBUG nova.compute.manager [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Start destroying the instance on the hypervisor. {{(pid=75203) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updated VIF entry in instance network info cache for port 9b0cbee1-d5c4-4184-b60b-de639548c134. {{(pid=75203) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.network.neutron [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [{"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f4658c7d-0f86-4936-a8a0-867a0d5a6d16 req-276d2009-6c6a-4331-b839-f2c1027b83f6 service nova] Releasing lock "refresh_cache-252c4ef2-8ecd-4011-bdb3-16578b7b5594" {{(pid=75203) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 28 19:34:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [-] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Instance destroyed successfully.
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.objects.instance [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lazy-loading 'resources' on Instance uuid 252c4ef2-8ecd-4011-bdb3-16578b7b5594 {{(pid=75203) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.vif [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-28T19:30:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-653914828',display_name='tempest-TestVolumeBootPattern-server-653914828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-653914828',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc4cLu0TS9BXVo0dL0/hs8YfiOnfZgwzAhoIfmVDtmDd1LWzkSKGa+gE1wealaqQ8pf1JNSO6EI27fR/Ca1p7dKDJ9sU82nwDe4XWV9yUoErGSuS6PwZNJne7RhS6yNjg==',key_name='tempest-TestVolumeBootPattern-183120276',keypairs=<?>,launch_index=0,launched_at=2023-11-28T19:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31eb98a16d749d59528a72449f26c46',ramdisk_id='',reservation_id='r-yxmai7kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1643995956',owner_user_name='tempest-TestVolumeBootPattern-1643995956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-28T19:30:14Z,user_data=None,user_id='a2c05ab9db4044e19fef91d0cab2ba03',uuid=252c4ef2-8ecd-4011-bdb3-16578b7b5594,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converting VIF {"id": "9b0cbee1-d5c4-4184-b60b-de639548c134", "address": "fa:16:3e:60:a6:68", "network": {"id": "49462e94-ca6f-4209-8c54-51f98bcf63c9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-156962728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31eb98a16d749d59528a72449f26c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b0cbee1-d5", "ovs_interfaceid": "9b0cbee1-d5c4-4184-b60b-de639548c134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.network.os_vif_util [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:a6:68,bridge_name='br-int',has_traffic_filtering=True,id=9b0cbee1-d5c4-4184-b60b-de639548c134,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0cbee1-d5') {{(pid=75203) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_vif [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a6:68,bridge_name='br-int',has_traffic_filtering=True,id=9b0cbee1-d5c4-4184-b60b-de639548c134,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0cbee1-d5') {{(pid=75203) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b0cbee1-d5, bridge=br-int, if_exists=True) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73e4f4f3-19ca-4384-bde3-08c07a054884) {{(pid=75203) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:34:53 user nova-compute[75203]: INFO os_vif [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a6:68,bridge_name='br-int',has_traffic_filtering=True,id=9b0cbee1-d5c4-4184-b60b-de639548c134,network=Network(49462e94-ca6f-4209-8c54-51f98bcf63c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b0cbee1-d5')
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] calling os-brick to detach iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f07a02122f0>, {'target_iqn': 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHMiknQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 28 19:34:53 user nova-compute[75203]: WARNING os_brick.initiator.connectors.base [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[113fc4fd-6aad-4936-be4f-d9777c4c0b1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 28 19:34:53 user nova-compute[75203]: No targets found.
Nov 28 19:34:53 user nova-compute[75203]: iSNS:
Nov 28 19:34:53 user nova-compute[75203]: No targets found.
Nov 28 19:34:53 user nova-compute[75203]: STATIC:
Nov 28 19:34:53 user nova-compute[75203]: Target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65
Nov 28 19:34:53 user nova-compute[75203]:         Portal: 172.16.0.220:3260,-1
Nov 28 19:34:53 user nova-compute[75203]:                 Iface Name: default
Nov 28 19:34:53 user nova-compute[75203]: FIRMWARE:
Nov 28 19:34:53 user nova-compute[75203]: No targets found.
Nov 28 19:34:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 28 19:34:53 user nova-compute[75203]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 28 19:34:53 user nova-compute[75203]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75203) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65', 0)] {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[091be83b-9e2a-4037-9181-ac4653063a09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a46d3-9fd5-4969-a43f-72923104f860]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:34:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 (non-flash)
Nov 28 19:34:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f07a00ed090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65'): ({'sdb'}, set())}) {{(pid=75203) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Removing single pathed devices sdb {{(pid=75203) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc71467b-b356-4f32-b96f-11ff4a2c639e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5a4eb4-425f-49e4-a971-404b0a7729ab]: (4, ('ok\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Flushing IO for device /dev/sdb {{(pid=75203) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[2411890f-52ef-4aea-a711-3cecaabbcde8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75203) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[72342433-af16-4e93-a558-aecb78cdada2]: (4, ('1', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.linuxscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] SCSI volumes sdb have been removed. {{(pid=75203) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO72210d85-67acfb7f01cfb48c', '/dev/disk/by-id/scsi-23637616366623766', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_72210d85') {{(pid=85951) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c6b85b-1957-4afe-a50c-2374dcd0fc51]: (4, None) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65')] {{(pid=75203) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff6525e-2b9d-4e33-b8cf-adb11584d2f8]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --logout {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8aeb79-64b9-4550-8be1-12f78fd73731]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260]
Nov 28 19:34:53 user nova-compute[75203]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65, portal: 172.16.0.220,3260] successful.
Nov 28 19:34:53 user nova-compute[75203]:  stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op delete {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b35c98-24f4-40d8-a805-2f950c060f65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85951) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7d3966-f566-426e-a446-6de73037d684]: (4, ('', '')) {{(pid=85951) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75203) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.base [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG os_brick.initiator.connectors.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] <== disconnect_volume: return (307ms) None {{(pid=75203) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 28 19:34:53 user nova-compute[75203]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Disconnected iSCSI Volume {{(pid=75203) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 28 19:34:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Deleting instance files /opt/stack/data/nova/instances/252c4ef2-8ecd-4011-bdb3-16578b7b5594_del
Nov 28 19:34:53 user nova-compute[75203]: INFO nova.virt.libvirt.driver [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Deletion of /opt/stack/data/nova/instances/252c4ef2-8ecd-4011-bdb3-16578b7b5594_del complete
Nov 28 19:34:54 user nova-compute[75203]: INFO nova.compute.manager [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 28 19:34:54 user nova-compute[75203]: DEBUG oslo.service.loopingcall [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75203) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [-] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Deallocating network for instance {{(pid=75203) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] deallocate_for_instance() {{(pid=75203) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.network.neutron [-] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Updating instance_info_cache with network_info: [] {{(pid=75203) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 28 19:34:54 user nova-compute[75203]: INFO nova.compute.manager [-] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Took 0.48 seconds to deallocate network for instance.
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-vif-unplugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] No waiting events found dispatching network-vif-unplugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-vif-unplugged-9b0cbee1-d5c4-4184-b60b-de639548c134 for instance with task_state deleting. {{(pid=75203) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] Acquiring lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] No waiting events found dispatching network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 28 19:34:54 user nova-compute[75203]: WARNING nova.compute.manager [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received unexpected event network-vif-plugged-9b0cbee1-d5c4-4184-b60b-de639548c134 for instance with vm_state active and task_state deleting.
Nov 28 19:34:54 user nova-compute[75203]: DEBUG nova.compute.manager [req-f68887e1-f8c1-4380-a0cd-5fdb504730f6 req-d78c022d-e799-4f1e-bf5e-be553534eed9 service nova] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Received event network-vif-deleted-9b0cbee1-d5c4-4184-b60b-de639548c134 {{(pid=75203) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 28 19:34:55 user nova-compute[75203]: INFO nova.compute.manager [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] [instance: 252c4ef2-8ecd-4011-bdb3-16578b7b5594] Took 0.75 seconds to detach 1 volumes for instance.
Nov 28 19:34:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:34:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:34:55 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:34:55 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:34:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:34:55 user nova-compute[75203]: INFO nova.scheduler.client.report [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Deleted allocations for instance 252c4ef2-8ecd-4011-bdb3-16578b7b5594
Nov 28 19:34:55 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-a458312e-e831-4049-9f0d-4a424e1357d0 tempest-TestVolumeBootPattern-1643995956 tempest-TestVolumeBootPattern-1643995956-project-member] Lock "252c4ef2-8ecd-4011-bdb3-16578b7b5594" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.679s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:34:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:35:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:35:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:29 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:35:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:35:29 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:35:29 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:35:30 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:35:30 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:35:30 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9115MB free_disk=24.890911102294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:35:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:35:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:31 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:35:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:34 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:35:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:39 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:35:43 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:35:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:43 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:35:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:52 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:55 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:35:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:17 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 28 19:36:17 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] There are 0 instances to clean {{(pid=75203) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 28 19:36:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:36:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:36:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:28 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:36:30 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:36:30 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:36:31 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:36:31 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9273MB free_disk=24.887229919433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing inventories for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating ProviderTree inventory for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Updating inventory in ProviderTree for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing aggregate associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, aggregates: None {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Refreshing trait associations for resource provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b, traits: COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_TRUSTED_CERTS {{(pid=75203) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:36:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:36:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:36:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:36 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:45 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:36:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:36:45 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:36:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:36:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:36:58 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:36:58 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Cleaning up deleted instances with incomplete migration  {{(pid=75203) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 28 19:37:03 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:08 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:13 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:18 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:37:23 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:26 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:28 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:37:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:30 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:31 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager.update_available_resource {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:37:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:37:31 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:37:31 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Auditing locally available compute resources for user (node: user) {{(pid=75203) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 28 19:37:32 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:37:32 user nova-compute[75203]: WARNING nova.virt.libvirt.driver [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 28 19:37:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Hypervisor/Node resource view: name=user free_ram=9273MB free_disk=24.881107330322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75203) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75203) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG nova.compute.provider_tree [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed in ProviderTree for provider: 124a0dbb-54e7-4217-a850-c2ea3ab9818b {{(pid=75203) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG nova.scheduler.client.report [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Inventory has not changed for provider 124a0dbb-54e7-4217-a850-c2ea3ab9818b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75203) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG nova.compute.resource_tracker [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Compute_service record updated for user:user {{(pid=75203) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 28 19:37:32 user nova-compute[75203]: DEBUG oslo_concurrency.lockutils [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75203) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 28 19:37:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:33 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:33 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75203) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 28 19:37:33 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:35 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:38 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:38 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:39 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:42 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:43 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:46 user nova-compute[75203]: DEBUG oslo_service.periodic_task [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75203) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 28 19:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Starting heal instance info cache {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 28 19:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Rebuilding the list of instances to heal {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 28 19:37:46 user nova-compute[75203]: DEBUG nova.compute.manager [None req-1cdb9a84-742c-460c-b517-6b3c8d1598ce None None] Didn't find any instances for network info cache update. {{(pid=75203) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 28 19:37:48 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 28 19:37:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75203) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 28 19:37:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:37:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75203) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 28 19:37:53 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 28 19:37:58 user nova-compute[75203]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75203) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}